I 


WL-TR-94-4002 

INTELLIGENT  AUTOMATED  PROCESS 
PLANNING  AND  CODE  GENERATION  FOR 
COMPUTER-CONTROLLED  INSPECTION 


AD-A275  346 

IHfilHlHMIH 


STEVEN  M.  RUEGSEGGER 


CASE  WESTERN  RESERVE  UNIVERSITY 
ELECTRICAL  ENGINEERING  AND  APPLIED 
PHYSICS 

CLEVELAND  OH  44106-7721 
JANUARY  1994 

FINAL  REPORT  FOR  08/01/91-01/01/93 


APPROVED  FOR  PUBLIC  RELEASE;  DISTRIBUTION  IS  UNLIMITED. 


MATERIALS  DIRECTORATE 

WRIGHT  LABORATORY 

AIR  FORCE  MATERIEL  COMMAND 

WRIGHT  PATTERSON  AFB  OH  45433-7734 


,j5  94-03099 

J  IBlIHIllll 


wr i 


o0  o 


Best 

Available 

Copy 


7 


NOTICE 

WHEN  GOVERNMENT  DRAWINGS,  SPECIFICATIONS,  OR  OTHER 
DATA  ARE  USED  FOR  ANY  PURPOSE  OTHER  THAN  IN  CONNECTION 
WITH  A  DEFINITELY  GOVERNMENT-RELATED  PROCUREMENT,  THE 
UNITED  STATES  GOVERNMENT  INCURS  NO  RESPONSIBILITY  OR  ANY 
OBLIGATION  WHATSOEVER.  THE  FACT  THAT  THE  GOVERNMENT  MAY 
HAVE  FORMULATED  OR  IN  ANY  WAY  SUPPLIED  THE  SAID  DRAWINGS, 
SPECIFICATIONS,  OR  OTHER  DATA,  IS  NOT  TO  BE  REGARDED  BY 
IMPLICATION,  OR  OTHERWISE  IN  ANY  MANNER  CONSTRUED,  AS 
LICENSING  THE  HOLDER,  OR  ANY  OTHER  PERSON  OR  CORPORATION; 
OR  AS  CONVEYING  ANY  RIGHTS  OR  PERMISSION  TO  MANUFACTURE, 
USE,  OR  SELL  ANY  PATENTED  INVENTION  THAT  MAY  IN  ANY  WAY  BE 
RELATED  THERETO. 


THIS  REPORT  IS  RELEASABLE  TO  THE  NATIONAL  TECHNICAL  INFORMATION  SERVICE  (NTIS).  AT 
NTIS  IT  WILL  BE  AVAILABLE  TO  THE  GENERAL  PUBLIC,  INCLUDING  FOREIGN  NATIONS. 

THIS  TECHNICAL  REPORT  HAS  BEEN  REVIEWED  AND  IS  APPROVED  FOR  PUBLICATION. 


juyS  Z-'l 

STEVEN  M.  RUEGSEGGER 
Research  Engineer,  Manufacturing  Research 
Integration  and  Operations  Division 
Materials  Directorate 


21  Dec  7J 

USAF 

Acting  Branch  Chief,  Manufacturing  Research 
Integration  and  Operations  Division 
Materials  Directorate 


ROBERT  L.RAPSON 

Chief,  Integration  and  Operations  Division 

Materials  Directorate 


IF  YOUR  ADDRESS  HAS  CHANGED,  IF  YOU  WISH  TO  BE  REMOVED  FROM  OUR  MAILING  LIST,  OR 
IF  THE  ADDRESSEE  IS  NO  LONGER  EMPLOYED  BY  YOUR  ORGANIZATION  PLEASE  NOTIFY 
WL/MLIM,  WRIGHT-PATTERSON  AFB,  OH  45433-7746  TO  HELP  MAINTAIN  A  CURRENT  MAILING  LIST. 

COPIES  OF  THIS  REPORT  SHOULD  NOT  BE  RETURNED  UNLESS  RETURN  IS  REQUIRED  BY 
SECURITY  CONSIDERATIONS,  CONTRACTUAL  OBLIGATIONS,  OR  NOTICE  §N  A  SPECIFIC 
DOCUMENT. 


REPORT  DOCUMENTATION  PAGE 


Form  Approved 
OMB  No.  0704-0188 


PuWic  resorting  burden  tor  this  collection  of  information  is  estimated  to  average  i  "Our  oer  response,  including  the  time  tor  reviewing  instructions,  searching  existing  data  sources, 
gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  o*  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this 
collection  of  information,  including  suggestions  for  reducing  this  burden,  to  Washington  neadouarters  Services.  Directorate  for  information  Operations  and  Reports.  1215  Jefferson 
Davis  Highway  Suite '2M.  Arlington,  VA  22202-4302.  and  to  the  Officeof  Management  and  Budget.  Paperwork  Reduction  Project  (0704-0 188).  Washington.  DC  20S03 


3.  REPORT  TYPE  AND  OATES  COVERED 


1.  AGENCY  USE  ONLY  (Leave  blank) 


4.  TITLE  AND  SUBTITLE 


2.  REPORT  DATE 
January  1994 


Final  August  1991  -  January  1993 


5.  FUNDING  NUMBERS 


Intelligent  Automated  Process  Planning  and  Code  Generation 
for  Computer-Controlled  Inspection _ 


6.  AUTHOR(S) 


Ruegsegger,  Steven  M  _ 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 


C: 

F33615-87-C-5250 

PE: 

62102F 

PR: 

2306 

TA: 

P9 

WU: 

03 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


Case  Western  Reserve  University 
Electrical  Enginering  and  Applied  Physics 
Cleveland  OH  44106-7721 


9.  SPONSORING /MONITORING  AGENCY  NAME(S)  AND  ADDRESSES) 

Materials  Directorate 

Wright  Laboratory 

Air  Force  Material  Command 

Wright  Patterson  AFB  OH  45433-7746 


11.  SUPPLEMENTARY  NOTES 


10.  SPONSORING  /  MONITORING 
AGENCY  REPORT  NUMBER 

WL-TR-94-4002 


Master's  Thesis  of  author 


12a.  DISTRIBUTION /AVAILABILITY  STATEMENT 


12b.  DISTRIBUTION  CODE 


Approved  for  public  release;  distribution  is  unlimited 


13.  ABSTRACT  (Maximum  200  words) 

Requirements  for  greater  precision  and  reduced  rejection  rates  demand  improved 
inspection  methods  that  can  be  provided  by  implementing  increased  automation  into 
the  process.  This  thesis  discusses  the  implementation  of  an  automated  intelligent 
inspection  planner  and  its  integration  into  a  feature-based  concurrent  engineering 
system.  The  approach  utilizes  features  as  the  common  language  of  the  individual 
modules  that  promote  ideas  of  geometry,  functionality,  and  design  intent  through¬ 
out  the  system  by  feature  translation  among  the  modules.  An  artificial  neural 
network  optimizes  the  sequence  of  inspection  points  based  on  inspection  rule  criteria 
A  collision  avoidance  algorithm  ensures  the  safety  of  automated  inspection  in  a 
computationally  efficient  manner.  The  goal  of  the  inspection  planner  is  to  output 
instruction  code  that  will  be  executed  on  a  computer-controlled  coordinate  measure¬ 
ment  machine  (CMM)  to  properly,  efficiently,  and  safely  measure  and  evaluate  the 
tolerances  of  the  manufactured  product. 


14.  SUBJECT  TERMS 

Automated  Inspection  Neural  Networks  Computer  Aided  Process 
Planning 


15.  NUMBER  OF  PAGES 

149 


16.  PRICE  CODE 


17.  SECURITY  CLASSIFICATION  1 18.  SECURITY  CLASSIFICATION  1 19.  SECURITY  CLASSIFICATION  T20.  LIMITATION  OF  ABSTRACT 
OF  REPORT  OF  THIS  PAGE  I  OF  ABSTRACT  I 


UNCLASSIFIED 


NSN  7540-01-280-5500 


CLASSIFIED 


CLASSIFIED 


Standard  Form  298  (Rev  2-89) 

Prescribed  by  ANSI  Std  239-18 
298-102 


Copyright  ©  1993  by 
Steven  Merril!  Rnegsegger 


ii 


to  my  wife,  father,  and  angel  mother 


Preface 


All  figures  and  text  results  in  this  thesis  axe  actual  results  produced  by  the 
methods  described  in  this  thesis. 

If  you  would  like  more  information  about  this  thesis,  the  Rapid  Design  System, 
or  would  like  information  on  how  to  receive  this  thesis  in  a  postscript  text  file,  please 
send  an  Internet  e-mail  request  to  smr2@po.cwru.edu. 


jUSPBCTE®  8 


IV 


Acknowledgments 


I  would  like  to  give  a  very  special  thanks  to  Dr.  Frank  Merai  for  whom  I  have 
enough  respect  to  call  “Dr.  Merai,”  yet  to  whom  I  also  feel  close  enough  to  call 
“Frank.”  He  has  been  my  advisor  fa-  about  five  years.  He  has  given  good,  honest, 
and  fair  advice  for  which  I  will  always  be  thankful. 

My  fellow  students  have  provided  much  assistance.  Bob  “rbd”  Delvalle  has 
shown  incredible  patience  to  put  up  with  my  current  crises  of  the  day.  Kavous 
“Kyous"  Roumina  gave  much  overall  direction  of  the  IPEM  Alok  “take-a-look” 
Mathur  was  always  willing  to  stop  what  he  was  doing  to  watch  me  figure  it  out  for 
myself.  Natarajan  “Yeah,  I  don't  know”  Balasundara  and  Leda  “See  ya  Leda” 
Villalobos  also  provided  assistance  whenever  asked  of  them. 

A  special  note  of  thanks  goes  to  Dr.  Yoh-Han  Pao.  IBs  researr  \  excellence 
provided  the  link  to  the  USAF  which  created  this  project  and  provided  the  computer 
facilities. 

Thanks  is  also  due  to  the  men  at  Wright-Patterson  Air  Force  Base,  MUM,  of 
whom  I  am  now  a  colleague.  Dr.  Walt  Griffith  and  Dr.  Steve  LeQair  have  headed 
the  Rapid  Design  System  research,  and  Dr.  Gerry  Radack  guided  every  module  of  the 
RDS  to  its  present  state,  providing  consistency  to  the  separated  group  of  researchers. 

A  final  note  of  appreciation  goes  to  my  family  for  their  love,  patience,  and 
prayers.  My  wife  Julie  has  demonstrated  true  Agape  spirit  throughout  the  long  hours 
of  research  and  writing.  Her  father,  Fred  Scheffier,  has  worked  diligently  with  the 
technical  editing  of  this  thesis,  making  it  readable. 


Table  of  Contents 


Abstract.. 


- u 


Preface. 


_ IV 


Acknowledgments - 

Table  of  Contents _ vi 

List  of  Illustrations . viii 

List  of  Tables _ xi 

1.  Introduction . 1 


2.  Background . 


_ 4 


2.1.  Project  Background.. 

2.2.  The  Problem _ 


2.3 .  Previous  Work _ _ _ 


_ 11 


2.4.  Object  Oriented  Programming . 14 

2.5.  Features . 15 

2.6.  Concurrent  Engineering . 17 

3.  Quality  Assurance. . . . . 19 

3. 1.  Geometric  Dimensioning  and  Tolerancing . 19 

3.2.  Computer-controlled  Inspection . 32 

3.3.  Automated  Inspection . . 34 


vii 


4.  Inspection  Planning  and  Evaluation  Module . 37 


4. 1 .  Automated  Inspection  Process  Planning . 


_ 40 


4.1.1.  CAD  Feature  Translation. 


4. 1.2.  Structure  Setup  and  Pre-plan  Geometric  Reasoning - 43 


4.1.3.  Plan  Sequencing . 


4.2.  Intelligent  Scheduling  Optimization . 


4.2.1.  Heuristic  Search  Scheduling . 


!♦»«««»« 


_ 56 


4.2.2.  Hopfield  Net  Scheduling  with  a  Rule-Based  Lyaponov 

Function  ...................................................... 63 


4.3.  Automated  CMM  Code  Generation. 


_ 77 


4.3.1.  The  CMES  Language . 


4.3.2.  Collision-free  Path  Planning . 


4.3.3.  Plan  Simulation . 

4.3.4.  Plan  Translation.. 


4.3.5.  Code  Generation. 


_ 93 

_ 95 

...... ............  1 00 


5.  Results. 


6.  Conclusions . . 116 

7.  Future  Work . . . 118 


References. 


Appendix  A . 125 

Appendix  B . 131 

Appendix  C . 133 


viii 


List  of  Illustrations 


1 1 .  Circularity  tolerance  callout  and  meaning . 27 

12.  Cylindricity  tolerance  callout  and  meaning . 28 

13.  Perpendicularity  tolerance  (surface)  callout  and  meaning. . 29 

14.  Parallel  tolerance  callout  and  meaning . — . 29 

15.  Angularity  tolerance  callout  and  meaning. . . 30 

16.  GD&T  provides  a  greater  tolerance  area  with  a  circular  tolerance 

zone . . . 31 

17.  Bonus  tolerances  applied  to  the  material  condition  modifiers. . 31 

1 8.  Concentricity  tolerance  callout  and  meaning . . . 32 

19.  Coordinate  measurement  machine . 34 


ix 


Three  different  evaluation  results  based  on  the  same  inspection 
points . 36 

IPEM  algorithm. . . . . . 39 


Each  design/tolerance  feature  combination  specifies  a  set  of  surfaces 
to  be  measured  ... ................................................................  42 


Inspection  plan  hierarchy. . 


Three  consecutive  axes  rotations. . . . . 45 

Datum  creation  within  a  DRF  that  contains  an  axis  datum . 46 

Growing  offset  surfaces  to  determine  for  internal  or  external  status . 48 

Convex  hull  results. _ _ _ _ _ _ 49 

Visibility  and  accessibility  tests  place  each  inspection  point  into  a 
setup  orientation . . . 50 

Three  CMM  program  code  structures. . _ . 55 


Flow  diagram  of  the  two-level  nearest-neighbor  algorithm. . 61 

Illustration  of  two-level  nearest-neighbor  search. . 62 

Qlustradon  of  two-level  nearest-neighbor  algorithm  with  multiple 
inspection  points  per  ^48. ......... 63 

Representation  of  neural  net  result. . 65 

Neuron  representation  and  input/output  functions. . 66 

Populating  the  S  matrix . . . 71 

The  S,  W,  and  F  matrices  used  to  implement  inspection  rules  into  the 
neural  network. . 73 


Illustration  of  ruie-based  ANN  sequence  result. . 77 

DRF  creation  within  the  CMES  language . . . 80 


Penalty  function  to  create  a  collision-free  path. . 82 


X 


40.  Safe  planes  are  offset  from  the  bounding  box  of  the  pan-model . 83 

41.  A  maximum  of  three  sub-paths  needed  to  connect  midal  and  goal 

points. . - . 84 

42.  Neighbor  nypotnesis  creation  method. . . 8  / 

43.  Via  point  creation  from  the  make-via-from-edge  function. - 89 

44.  Two-doors-down  hypothesis  creation  method. . —  90 

45.  2-level-geometry- 1  hypothesis  creation  method. . 91 

46.  Up-and-over  hypothesis  creation  method. . 93 

47.  The  simulation  layout  within  the  RDS . 95 

48.  Origin  and  axes  creation  defined  from  the  datum  of  the  DRF . 98 

49.  The  coordinate  frames  within  the  inspection  scheme . 99 

50.  Pan-model  and  axes  rotation  from  CAD  default  to  inspector 

desired  orientation . 102 

51.  The  Feature  Based  Design  Environment. . 106 

52.  Tolerances  overlaid  on  pan-model. . 107 

53.  The  button  menu  of  the  Inspection  Planning  and  Evaluation  Module 

layout . 107 

54.  Results  from  artificial  neurai  network  schedule  optimization . 109 

55.  Collision  avoidance  algorithm. . 110 

56.  CMM  simulation . 115 


xi 


List  of  Tables 


1.  Geometric  Dimensioning  and  Toieranring  characteristics  and  symbols..  21 

2.  Allowable  design/tolerance  feature  combinations  within  the  IPEM. - 41 


j. 


Inspection  point  constraints  on  placement  based  on  design/tolerance 
feature  cot^tbwanons*  . mi . .  — r — - 42 


xii 


List  of  Abbreviations 


2- D . Two  Dimension 

3- D . Three  Dimensional 

A1 . Artificial  Intelligence 

ANN . Artificial  Neural  Network 

ANSI . American  National  Standard  Institute 

CAD . Computer  Aided  Design 

CAM . Computer  Aided  Manufacturing 

CAI . Computer  Aided  Inspection 

CAPP . Computer  Aided  Process  Planning 

QM . Computer  Integrated  Manufacturing 

CLOS . Common  LISP  Operating  System 

CMES . Coordinate  Measurement  Software 

CMM . Coordinate  Measurement  Machine 

DMIS . Dimensional  Measurement  Interface  Specification 

dof . degrce(s)  of  freedom 

DRF . Datum  Reference  Frame 

EAM . Episodal  Associative  Memory 

FBDE . Feature  Based  Desip  Environment 

FAB-PLAN ...  Fabrication  Planning 

GD&T . Geometric  Designing  and  Tolerancing 

IPEM . Inspection  Planning  and  Evaluation  Module 

IPF . Inspection  Plan  Fragment 

LMC . Least  Material  Condition 

MMC . Maximum  Material  Condition 

MR . Measurement  Request 

OOP . Object  Oriented  Programming 

QA . Quality  Assurance 

RDS . Rapid  Desip  System 

RFS . Regardless  of  Feature  Size 

TSP . Traveling  Salesman  Problem 


xiii 


Chapter  1 
Introduction 

People  who  like  this  sort  of  thing 
will  find  this  the  sort  of  thing  they  like 

-  Abraham  Lincoln 

The  task  of  the  Quality  Assurance  (QA)  engineer  is  to  determine  if  the  geome¬ 
tries  of  the  product  are  within  the  specified  tolerances  created  by  the  design  engineer. 
The  results  should  determine  whether  or  not  die  product  will  perform  its  desired 
functions  correctly.  Today's  technologies  have  provided  a  diverse  range  of  auto¬ 
mated  inspection  systems  for  QA.  The  primary  measurement  technique  used  in 
automated  industrial  inspection  of  machined  pans  is  the  coordinate  measurement  ma¬ 
chine  [Galm,  1991]  [Menq,  et  at,  1991a]  [ELMaraghy  and  Gu,  1987].  Advanced 
graphical  programming  tools  have  also  simplified  some  aspects  of  the  automated  in¬ 
spection  process.  Computer-aided  design,  process  planners,  path  planners,  and 
simulators  provide  assistance  to  the  inspector. 

This  thesis  discusses  the  implementation  of  an  automated  inspection  planner 
operating  within  a  feature-based  concurrent  engineering  system  called  the  Rapid 
Design  System  (RDS).  The  RDS  contains  software  modules  to  automate  the  design, 
manufacture,  and  inspection  aspects  of  product  fabrication,  as  well  as  an  artificial 
intelligence  memory  to  provide  advanced  storage  and  retrieval  of  designs.  The 
automated  inspection  planner  interfaces  to  the  CAD  system  to  receive  the  design, 
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tolerance,  and  function  intent  information.  The  task  of  the  automated  inspection 
planner  is  to  produce  the  inspection  plan  which  properly  evaluates  the  tolerances  on 
the  manufactured  product  Important  aspects  of  an  automated  inspection  plan  include 
a  safe,  collision-free,  and  efficient  path  trajectory  throughout  the  probe-space.  The 
output  is  generated  as  actual  instruction  code  that  controls  the  execution  of  the  in¬ 
spection  plan  on  a  computer-controlled  coordinate  measurement  machine.  The  out¬ 
put  is  complete  and  will  require  no  human  editing  (or  at  least,  no  more  than  fine- 
tuning  or  “tweaking”)  before  the  code  can  be  executed. 

The  individual  accomplishments  of  this  thesis  introduced  several  important 
elements  into  the  automated  inspection  planner  of  the  RDS: 

1.  An  artificial  neural  network  performs  sequence  opdmizaiion  on  the 
inspection  points  using  an  inspection  rule  based  criterion. 

2.  A  computationally  efficient  collision-avoidance  algorithm  creates  a  safe 
path  for  the  probe  head  to  travel  around  the  workpiece. 

3.  An  automated  code  generator  produces  the  CMM  instructions  that  will 
safely,  efficiently,  and  correctly  evaluate  the  tolerance  on  the  workpiece. 

Thesis  Overview 

Chapter  2  provides  important  background  information  and  a  literature  review  to 
provide  better  understanding  of  the  work  described  in  this  thesis  as  well  as  relate  it  to 
research  in  similar  areas.  Since  the  work  of  this  thesis  is  a  sub-pan  of  a  concurrent 
engineering  system,  some  aspects  of  the  larger  project  are  discussed  to  place  proper 
perspective  of  how  this  thesis  fits  into  the  intentions  of  the  engineering  system.  The 
engineering  tools  and  techniques  of  object  oriented  programming,  the  feature  and 
hierarchical  paradigms,  and  concurrent  engineering  are  also  described.  Chapter  3 
discusses  the  theme  of  the  research:  quality  assurance.  The  standards,  formats,  and 
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techniques  of  quality  assurance  used  in  this  research  are  described.  They  include  the 
ANSI  Y14.5M-1982  tolerancing  standard,  coordinate  measurement  machines,  and 
automated  inspection. 

Chapter  4  discusses  the  implementation  of  the  intelligent  automated  inspection 
planner.  The  work  of  several  researchers  (see  Acknowledgments)  and  their  contribu¬ 
tion  to  this  thesis  is  developed  in  sections  4.1  and  4.2.1.  Sections  422  through  4.3 
describe  the  individual  research  and  implementation  of  work  performed  to  achieve 
this  thesis.  An  example  of  a  product's  representation  at  each  stage  throughout  the 
inspection  planner  is  illustrated  in  Chapter  5. 

This  thesis  closes  with  conclusions  and  future  work  in  chapters  6  and  7,  respec¬ 
tively.  Appendix  A  shows  the  inspection  language  macros  that  create  the  output  of 
the  inspection  planner.  Appendix  B  gives  a  quick  reference  to  the  inspection  lan¬ 
guage  of  the  coordinate  measurement  machine  owned  by  the  end-user  of  the  Rapid 
Design  System.  It  can  be  used  to  clarify  the  examples  and  to  give  the  reader  an  un¬ 
derstanding  of  one  reason  for  the  necessity  of  an  automated  inspection  planner.  The 
inspection  rule-based  artificial  neural  network  program  code  is  presented  in 
Appendix  C. 


Chapter  2 
Background 


Those  who  cannot  remember  the  pass 
are  condemned  to  repeat  it. 

-  George  Santayana 


This  chapter  describes  the  factors  that  influenced  this  research.  The  larger  re¬ 
search  project  of  the  concurrent  engineering  system  defined  the  project  platform  and 
software  implementation  language.  A  problem  and  approach  were  constructed  by 
studying  the  efforts  of  the  QA  engineers  at  the  4950th  Test  Wing,  Wrighi-Panerson 
Air  Force  Base  as  they  performed  their  job  of  inspecting  manufactured  pans  using 
their  newly  acquired  CMM.  A  literature  review  helped  guide  this  research  by 
introducing  new  ideas  that  could  be  developed  further.  Finally,  background  topics 
critical  to  this  research  effort  are  explained  and  defined. 

2.1.  Project  Background 

This  work  is  encompassed  by  a  project  funded  by  the  U.S.  Air  Force  to  develop 
an  intelligent  expen  system  which  reduces  the  turnaround  rime  of  a  product  from  de¬ 
sign  to  manufacture  and  inspection.  This  system,  called  the  Rapid  Design  System 
(RDS),  is  being  developed  with  the  cooperation  of  an  Air  Force  design  and  manufac¬ 
turing  Test  Wing  [Le  Clair,  1991].  This  organization  specializes  in  the  custom  design 
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and  manufacture  of  aircraft  replacement  parts  which  are  no  longer  available  from  the 
original  manufacturer.  Therefore,  the  lot  sizes  are  very  small,  typically  ranging  from 
one  to  twenty.  For  these  small  batch  sizes,  the  highest  time  factor  is  the  lead  tune  in 
product  plan  development  in  both  the  manufacturing  and  inspection  arenas.  The 
objective  of  the  RDS  is  to  drastically  reduce  this  lead  time  by  providing  information 
links  throughout  the  life  cycle  of  the  product.  Both  the  manufacturer  and  inspector 
receive  the  entire  feature-based  part-model  that  the  designer  created,  rather  than  an 
engineering  drawing  or  a  simple  surface  representation.  This  allows  the  process 
planner  to  use  ail  the  function  and  tolerance  intent  inherent  in  the  design  and 
tolerance  features. 

The  RDS  is  built  upon  the  Concept  Modeler™,  a  parametric  design  system 
from  Wisdom  Systems,  Inc.  The  Concept  Modeler™  is  built  upon  Common  LISP 
Operating  System  (CLOS),  an  object-oriented  programming  language  with  inheri¬ 
tance.  The  RDS  uses  these  platforms  to  provide  features  used  throughout  the  concur¬ 
rent  engineering  system. 

The  four  RDS  modules  are  as  follows:  the  Episodal  Associative  Memory,  the 
Feature-Based  Design  Environment,  the  Fabrication  Planning  module,  and  the 
Inspection  Planning  and  Evaluation  module.  The  overall  purpose  of  the  RDS  is  to 
provide  a  common  language  that  allows  these  different  modules  to  be  interconnected 
so  that  process  planning  and  other  artificial  intelligence  heuristics  can  use  the  trans¬ 
lated  data.  Its  goal  is  to  relieve  the  manufacturer  or  inspector  from  the  guess-work 
often  involved  in  interpreting  the  tolerancing  and  functional  design  intent  of  a  prod¬ 
uct  once  it  is  “thrown  over  the  engineering  wail.” 
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Rapid  Design  System 

NC  code 

QuMOMlS 

Figure  L  Rapid  Design  System  overview. 

The  Episodal  Associative  Memory  (EAM)  is  a  computer-based  associative 
memory,  whose  purpose  is  to  augment  the  human  designer's  memory  by  providing  an 
institutional  or  collective  memory  fa*  all  phases  of  the  product's  life  cycle  (Pao,  et  al_ 
1991].  Information  regarding  the  successes  and  failures  of  a  product  from  each  of  its 
production  stages  is  stored  in  the  memory.  The  life  cycle  memory  includes 
information  from  the  designer,  manufacturer,  and  inspector.  This  experience  data  of 
similarly  designed  parts  is  then  “remembered”  by  the  memory  when  a  new  pan  is 
introduced  into  the  system.  The  goal  is  to  avoid  the  costly  mistakes  that  occurred 
previously  and  to  reiterate  positive  factors  of  all  aspects  of  the  similar  product's  life 
cycle.  The  designer  can  leant  from  the  trials  and  solutions  of  the  fabrication  or 
inspection  engineers.  These  trials  and  solutions  might  not  otherwise  be  considered 
due  to  job  turnover,  promotions,  forgetfulness,  disorganization,  misplaced  or 
destroyed  papers,  etc. 

The  Feature-Based  Design  Environment  (FBDE)  is  the  front-end  CAD  system 
where  the  designer  creates  the  product.  In  the  feature-based  design  paradigm  (section 
2.5),  the  product,  or  pan  model,  is  described  in  terms  of  features  which  represent 
higher-level  concepts  than  the  geometric  primitives  used  in  traditional  CAD  systems 
[Radack,  et  al.,  1991].  Most  commercially  available  computer-aided  drafting  systems 
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are  wire-frame  representations  which  depict  objects  by  geometric  primitives:  points, 
lines,  curves,  circles,  etc.  Toierancing,  whether  it  is  the  ANSI  geometric  standard  or. 
more  commonly,  the  traditional  rectangular  (±)  standard,  is  accomplished  by  placing 
text  and  an  arrow  in  the  drawing,  not  linking  it  in  any  way  to  the  actual  geometry  of 
the  pan  model. 

The  FBDE  uses  Constructive  Solid  Geometry  (CSG)  to  represent  the  3-D  pan 
model.  One  class  of  features,  called  “form- features, ”  contains  both  negative  volume 
features  such  as  holes  and  pockets,  as  well  as  positive  volume  features  such  as  bosses 
and  ribs.  When  attached  to  a  feature  or  sub-feature,  negative  volume  features  will 
remove  material,  while  positive  volume  features  will  add  material-  Another  class  of 
features  serves  to  modify  the  geometry  of  the  form  feature,  e.g.,  chamfers  and  fillets. 
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Figure  2.  Design  features  implemented  within  the  RDS. 


The  FBDE  also  represents  dimensioning  and  toierancing  information  within  the 
pan  model  using  the  feature  paradigm.  The  representation  conforms  to  the  ANSI 
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Y14.5M  standard  called  Geometric  Dimensioning  and  Tolerancing  (GD&T),  e.g., 
straightness,  posidon,  and  flatness.  These  tolerance  features  are  attached  to  geomet¬ 
ric  features  or  surfaces  of  the  pan  model  representing  the  proper  GD&T  callout  pro¬ 
cedure,  as  well  as  ueeuea  information  for  the  process  planner. 


Sim pie  Datum  Sasic  Dimension  Datum  Reference  frame  Flatness 


Figure  3.  Tolerance  features  implemented  within  the  RDS. 


Fabriconon  Planning  (FAB-PLAN)  outputs  the  instruction  code  necessary  to 
manufacture  the  pan  on  a  computer  numerically-controlled  (CNQ  machine 
[Westhoven,  1991],  Its  input  is  the  feature-based  description  of  the  product  from  the 
FBDE  which  is  translated  into  fabrication  features.  FAB-PLAN  uses  a  machining 
database  called  Met-CAPP™,  which  determines  the  proper  milling  machine  and  the 
corresponding  speeds  and  feeds  for  each  fabrication  feature,  then  passes  them  as 
parameters  into  the  process  planner. 
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Inspection  Planning  and  Evaluation  Module  (IPEM)  automatically  generates 
instruction  code  to  be  executed  on  a  computer-controlled  coordinate  measurement 
machine  (CMM)  [Merat  and  Radack.  1992]  [Menu,  et  ai.,  1991].  IPEM  is  the 
module  that  this  thesis  discusses.  The  first  sap  is  the  translation  of  the 
design/tolerance  feature  combinations  from  the  FBDE  into  inspection  features.  The 
inspection  process  planner  uses  a  generative  approach  to  create  the  setups  and 
sequencing  of  the  tolerance  measurements  and  evaluations.  The  path  planner  ensures 
an  efficient  path  trajectory  according  to  an  inspection  rule  criteria,  and  then  makes  it 
a  collision- free  path.  The  automated  code  generator  translates  the  inspection  features 
into  a  language  that  the  CMM  will  understand. 

2.2.  The  Problem 

As  computers  become  faster,  heuristics  more  comprehensive,  and  software 
more  user-friendly,  many  new  technologies  have  been  realized  in  the  industry  arena. 
CAD  (computer  aided  design)  and  CIM  (computer  in  a  grated  manufacturing)  have 
become  standard  tools  for  most  manufacturing  companies.  On  a  much  smaller  scale, 
CAI  (computer  aided  inspection)  and  CAPP  (computer  aided  process  planning)  have 
also  been  accepted  by  industry.  However,  these  advances  have  resulted  in  distinct 
“pockets”  of  computer-assistance  which  are  not  complea  in  themselves,  and  integra- 
don  among  them  is  still  labor  intensive. 

Many  tools  have  been  developed  to  aid  the  inspector  with  the  inspecdon  proc¬ 
ess.  The  tolerance  standard,  ANSI  Y14.5M  -  1982,  provides  a  tolerance  language 
that  communicates  to  the  inspector  the  intended  function  of  the  product.  Computer- 
aided  inspecdon  planners  prepare  the  detailed  work  instrucdons  to  inspect  a  pan. 
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Stand-alone  computer  programs  are  also  available  to  the  inspector  that  aid  in  auto¬ 
mated  inspection  code  programming.  One  type  of  program  offers  a  graphical  user  in¬ 
terface  that  creates  a  plan  by  the  concatenation  of  tolerance  macros  linked  to  graphi¬ 
cal  buttons.  Another  software  package  will  input  an  engineering  drawing  by  a  stan¬ 
dard  interface,  tracing,  or  some  other  manual  technique,  and  simulate  the  probe  path 
by  overlaying  the  connected  specified  measurement  points  over  the  pan-model. 

While  these  computer  aids  are  useful,  considerable  human  interface  time  is  re¬ 
quired  to  use  the  products  together,  not  to  mention  separately.  There  are  so  many 
different  types  of  information  standards  that  these  computer  products  are  not  connect¬ 
able,  and  translating  between  them  is  often  more  work  than  the  services  provided. 

For  example,  many  CAD  systems  cannot  represent  Geometric  Dimensioning  and 
Tolerancing  (GD&T)  properly  and  may  not  even  support  it  at  ail.  Process  planners 
need  both  the  tolerances  and  a  3-D  representation  of  the  pan  model  including 
surfaces  and  features:  many  CAD  systems  can  only  use  2-D  geometric  primitives. 
Most  process  planners  output  a  text  file  containing  manual  instructions  describing  the 
sequence  of  tolerance  measurements  and  setup  orientations.  However,  this 
information  cannot  be  used  directly  by  the  automated  inspection  software  generator 
therefore,  the  inspector  must  translate  the  manual  instructions  into  automated  CMM 
code. 


Motivation 

The  motivation  for  this  thesis  is  to  relieve  the  inspector  from  the  tedious  and 
time-consuming  chores  of  inspection  planning  which  can  be  automated  by  the  com¬ 
puter.  To  reveal  the  needs  of  the  inspector,  the  daily  operations  of  the  QC  engineers 
at  the  4950th  Test  Wing  were  observed.  First,  a  manufactured  product  and 
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engineering  drawing  is  given  10  them.  Hours  are  spent  to  interpret  and  understand 
the  design  function  of  the  product  as  a  whole,  and  the  features  within  the  product  If 
the  product  is  not  toleranced  using  the  GD&T  standard,  then  datums  and  datum 
reference  frames  (DRFs)  must  be  created.  An  inspection  strategy  is  created  which 
specifies  the  setups,  fixruring,  and  DRJF  sequencing  into  the  setups.  The  most  tedious 
and  error-prone  task  is  next:  the  placement  and  sequencing  of  inspection  points  into 
a  collision  free  path.  This  process  includes  applying  3-D  trigonometry  with 
accuracies  of  thousandths  of  an  inch.  Currently,  the  inspectors  use  a  hand-held 
calculator  to  perform  these  calculations.  Finally,  the  automated  inspection  code  is 
created  by  typing  the  coordinate  points,  tolerance  values,  and  cryptic,  hard-to- 
remember  CMM  instructions  into  a  simple  word  processor.  This  process  is  extremely 
tedious  and  error-prone,  yet  critical,  since  any  typographical  error  could  send  the 
probe  crashing  into  the  product  or  CMM  table.  If  the  computer  can  be  employed  to 
perform  these  routine  but  complex  tasks,  then  the  inspector  can  focus  his  expertise  on 
unique  and  unexpected  problems  that  no  algorithm  can  be  programmed  to  foresee. 
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The  constraints  of  the  RDS  system  for  the  work  discussed  in  this  thesis  are:  (1) 
prismatic  products,  (2)  products  made  from  aluminum  stock,  and  (3)  execution  of  the 
inspection  plan  on  a  CMM  with  three  degrees  of  freedom. 

2.3.  Previous  Work 

There  are  several  bodies  of  literature  relevant  to  this  work:  process  planning, 
optimization,  collision  avoidance,  inspection  techniques,  code  generation,  and  evaiu- 


anon  methods.  Although  there  is  a  significant  amount  of  material  in  all  these  areas, 
there  is  little  integration  among  them.  The  focus  of  this  work  is  to  combine  and  inte¬ 
grate  these  areas.  Some  of  this  work  is  paralleled  in  automated  process  planning  for 
manufacturing.  Caroline  Hayes  (1990)  gives  many  references  to  previous  machining 
planning  systems. 

Most  of  automated  inspection  planning  literature  has  been  described  in  the  aca¬ 
demic  arena.  ElMaraghy  and  Gu  (1988)  have  described  an  inspection  task  planning 
system  for  CMMs.  Their  system  is  based  on  a  feature-oriented  computer-aided 
modeling  system  which  was  limited  to  cylindrical  starting  stock  and  turned  pans. 

One  significant  aspect  of  their  work  was  the  use  of  the  ANSI  Y14.5  tolerances  to 
govern  their  rule-based  system.  Other  similar  research  has  been  done  in  the  field  of 
vision-based  inspection  systems.  Traband  and  Medeiros  (1988)  describe  a  methodol¬ 
ogy  for  extracting  the  design  information  from  a  CAD  system  to  control  a  two-di¬ 
mensional  video  inspection  system. 

An  important  pan  of  the  inspection  plan  is  the  placement  of  the  inspection 
points.  The  placement  of  the  points  to  be  measured  must  be  accessible  to  the  CMM 
probe  within  the  given  setup.  If  the  point  is  not  accessible,  the  setup  must  be 
changed,  or  probe  extensions  and  other  degrees  of  freedom  of  the  CMM  must  be 
utilized.  Spyridi  and  Requicha  (1990)  discuss  using  accessibility  cones  to  determine 
if  the  inspection  points  can  be  reached  by  the  CMM  probe. 

Hopp  and  Lau  (1985)  present  two  alternative  control  systems  for  generating  an 
inspection  plan  and  then  creating  the  CMM  commands  to  execute  the  plan.  The  first 
system  uses  feature  decomposition  on  functional  and  tolerance  features.  The  second 
system  uses  geometric  decomposition  to  translate  surfaces  directly  into  inspection 
points. 
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The  IPPEX,  a  knowledge-based  system  for  dimensional  inspection,  performs 
its  inspection  task  based  on  pre-processed,  solid-model  geometric  information  as  well 
as  tolerance  information  (Brown,  1990  &  1983],  The  output  is  in  the  form  of  DMIS 
(Dimensional  Measuring  Interface  Specification)  code  to  operate  a  CMM.  The  major 
accomplishment  of  the  IPPEX  was  an  expen  system  to  determine  which  type  of 
CMM  would  be  the  best  to  perform  an  inspection  plan  based  on  the  pan  size  and  in¬ 
spection  plan  complexity. 

Menq  et  al.  (1991a,  1991b,  1992a,  &  1992b)  have  developed  an  intelligent 
planning  environment  for  automated  dimensional  inspection  using  CMMs.  Their 
system  is  limited  to  pans  described  by  complex  and  sculptured  surfaces  within  the 
IBM  CATTA  CAD/CAM  system.  They  excelled  in  developing  localization  algo¬ 
rithms  to  mathematically  locate  the  pan  on  the  CMM  table  prior  to  inspection  using 
complex  surface  fitting.  However,  this  method  does  not  use  the  ANSI  Y14.5  method 
of  creating  a  datum  reference  frame  and  then  comparing  the  measurements  to  the 
theoretically  perfect  coordinate  axes  it  creates. 

The  work  presented  by  Jeon  (1990)  used  an  artificial  neural  network  to  se¬ 
quence  the  inspection  points  using  a  Euclidean  distance  weight  criterion.  To  meet  in¬ 
spection  methodology  standards,  the  sequencing  was  limited  to  a  per  surface  basis. 

One  interesting  industry  application  reported  using  the  Hopfield  artificial  neu¬ 
ral  network  as  a  discrete  event  sequencing  problem  in  the  area  of  hot  strip  milling  for 
steel  production  (Kosiba,  et  aL,  1992].  The  neural  network  used  a  penalty  function 
based  on  steel  width,  hardness,  and  gauge  as  constraints  to  search  for  the  minimum 
cost  solution.  The  result  was  a  minimal  cost  path  that  defined  the  sequence  of  steel 
orders  that  make  up  the  batch  runs. 
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2.4.  Object  Oriented  Programming 

^  ^  ^  ! 

wvj  iCiliCCl  aiij  4  t*A#4«*Wfc*  Ol  SOitV^diC 

in  which  programs  are  organized  as  cooperative  collections  of  objects,  each  of  which 
represents  an  instance  of  some  class,  and  whose  classes  are  members  of  a  hierarchy  of 
classes  united  via  inheritance  relationships  [Booch,  1991].  Unlike  conventional  pro¬ 
gramming  which  is  built  upon  algorithms,  OOP  is  built  upon  objects.  These  objects 
are  created  from  instantiations  of  classes.  Classes  are  defined  in  an  inheritance  struc¬ 
ture,  where  a  sub-class  can  inherit  properties  from  its  super-class.  At  the  very  top  of 
the  inheritance  chain  is  usually  a  class  called  a  primitive,  which  is  a  pre -defined  class 
that  is  a  standard  with  the  particular  software  implementation. 

As  a  simple  example,  consider  an  object  instance  called  game-ball  that  rep¬ 
resents  a  soccer  ball  used  for  games  only.  This  object  instance  can  be  associated  with 
(instantiated  from)  sub-class  soccer-ball  which  has  properties  size,  stitch¬ 
ing,  and  color.  Other  instances  of  this  same  sub-class  soccer-ball  could  be 
practice-ball  or  loaner-ball.  The  differentiating  features  among  the  in¬ 
stances  are  the  values  of  their  properties  (or  slots)  when  the  object  instance  was  cre¬ 
ated.  The  sub-class  soccer-ball  would  inherit  attributes  from  its  super-class 
ball,  having  properties  air-inflation-pressure  and  material.  The 
class  ball  is  defined  from  the  primitive  class  sphere  with  property  radius. 
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Figure  4.  Class  hierarchy  illustration. 


2.5.  Features 

The  quest  for  completely  automated  process  planning  systems  has  exposed  the 
lack  of  techniques  capable  of  automatically  understanding  the  stared  CAD  models  in 
a  manner  suitable  for  process  planning  [Joshi  and  Chang,  1990].  Traditional  CAD 
systems  enhance  product  design  simply  by  automating  the  drafting  process.  They 
operate  at  a  low  level  in  terms  of  product  representation,  i.e.,  the  design  information 
is  represented  in  terms  of  geometric  and  topological  primitives:  points,  lines,  sur¬ 
faces.  etc.  The  pan  description  in  a  3-D  CAD  model  (parametric  surfaces  and 
boundary  representation)  is  in  a  form  unsuitable  for  direct  application  to  process 
planning.  Therefore,  many  process  planners  have  to  interpret  the  CAD  information 
using  a  feature-recognition  pre-processor  to  conven  it  to  meaningful  manufacturing 
or  inspection  process  information. 
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The  approach  of  this  research  is  to  eliminate  the  ambiguities  between  computer 
assistance  programs  that  have  required  the  use  of  the  manual  translation  or  automatic 
pre-processing  before  the  process  planner  can  be  utilized.  The  use  of  features  within 
the  CAD  system  and  process  planning  ot  UM/CAi  can  provide  a  common  language 
among  them.  The  features  can  propagate  not  only  geometry,  but  also  design  intent, 
functionality,  and  other  pan  expectancies  from  the  designer  to  the  manufacturer  and 
inspector.  Integrating  the  process  planner  to  CAD  using  the  feature  paradigm  in¬ 
volves  a  feature-translator  that  uses  rules  to  map  the  features  through  the  interfaces. 

A  feature  has  been  defined  in  many  ways.  One  definition  is  “computer  repre¬ 
sentable  data  relating  to  functional  requirements,  manufacturing  [or  inspection]  proc¬ 
ess,  or  physical  properties  of  design”  (Joshi  and  Chang,  1990].  The  most  common 
features,  representing  geometrical  design,  include  through  holes,  blind  holes,  edge 
cuts,  pockets,  ribs,  etc.  (Figure  2  on  page  7).  Negative  features  are  defined  to  consist 
of  negative  volume,  or  they  take  away  matexial  from  their  attachment  feature  or  sub- 
feature.  A  hole  is  an  example  of  a  negative  feature.  Positive  features  are  defined  to 
consist  of  positive  volume,  or  they  add  material  to  their  attachment  feature  or  sub- 
feaiure.  A  rib  is  an  example  of  a  negative  feature. 

Another  type  of  feature  represents  the  GD&T  tolerances  which  are  attached  to 
other  features  and  surfaces  (Figure  3  on  page  8).  The  combinations  of  design  and 
tolerance  features  create  inspection  features  which  represent  the  finite  elements  of  the 
inspection  plan. 
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2.6.  Concurrent  Engineering 

Concurrent  engineering  (sometimes  called  simultaneous  engineering  or  life  cy¬ 
cle  engineering)  involves  the  simultaneous  consideration  of  product,  function,  design, 
materials,  manufacturing  processes,  and  cost,  taking  into  account  later-stage  consid¬ 
erations  such  as  testability,  serviceability,  quality,  reliability,  and  redesign  [Y oung,  et 
aL,  1992].  Concurrent  engineering  involves  the  consideration  of  ail  aspects  of  proper 
creation  and  life-duration  of  the  product  as  early  as  possible  —  the  design  stage. 

This  is  especially  important  in  small  batch  manufacturing  and  quality  control  opera¬ 
tions  since  it  is  at  the  design  stage  that  the  life  cycle  requirements  are  defined.  The 
decisions  of  the  designer  affect  every  aspect  of  the  successful  creadon  of  that  prod¬ 
uct. 

The  United  States  has  a  reputation  that  concurrent  engineering  techniques  are 
generally  not  well  performed  [Young,  et  aL,  1992].  It  has  been  suggested  (with 
tongue  in  cheek)  that  the  designer  ‘throws  the  plans  over  the  wall”  to  the 
manufacturer  who  changes  much  of  the  design's  tolerances  when  it  is  discovered  that 
they  cannot  be  met.  The  manufacturer  then  ‘‘throws  the  pan  and  the  designs  over  the 
wall”  to  the  inspector  who  discovers  that  many  of  the  tolerances  were  not  met  and 
the  part  must  be  reworked.  The  result  is  an  unnecessary  increase  of  work,  cost  and 
dme  accurtiukdng  into  the  product 

There  are  a  number  of  techniques  and  systems  that  support  concurrent  engi¬ 
neering  by  advising  designers  on  aspects  that  reduce  life  cycle  problems.  These  in¬ 
clude  design  teams,  design  handbooks,  checklists  and  structured  procedures,  manu- 
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facturing  (and  inspection)  simulation  and  process  planning,  and  the  use  of  expert 
systems  [Young,  et  aL,  1992]. 

In  the  RDS,  concurrent  engineering  is  accomplished  through  the  use  of  fea¬ 
tures  as  the  keys  to  the  expen  systems.  The  features  have  knowledge  about  them¬ 
selves,  i.e.,  they  have  rules  on  how  they  are  to  be  manufactured,  inspected,  and  inter¬ 
relate  with  one  another.  Therefore,  rules  and  constraints  of  the  manufacturing  and  in¬ 
spection  disciplines  can  be  attached  to  the  design  and  tolerance  features  in  the  FBDE 
to  provide  the  designer  with  knowledge  that  would  not  normally  be  known.  For  ex¬ 
ample,  a  hole  feature  is  placed  onto  the  starting  block  by  the  designer.  The  designer 
will  be  warned  that  a  constraint  has  been  violated  if  he  makes  the  heighcradius  ratio 
too  large,  which  causes  the  machining  drill  to  chatter.  The  solution  is  a  wider, 
shorter,  or  tapered  hole.  Accordingly,  if  a  datum  reference  frame  is  created  with  the 
tertiary  surface  having  much  more  surface  area  than  the  secondary  surface,  the  de¬ 
signer  will  be  warned  that  the  opposite  situation  is  desirable  for  optimum  inspection. 

Another  aspect  of  concurrent  engineering  that  is  not  covered  in  this  research  is 
the  use  of  the  EAM.  Problems  and  solutions  encountered  in  the  manufacturing  or  in¬ 
spection  arena  are  stored  with  the  pan  model  at  the  time  of  occurrence.  Then,  at  a 
later  date  when  a  similar  pan  is  introduced  into  the  RDS  by  the  designer,  that  wealth 
of  past  experience  is  available  to  the  designer. 


Chapter  3 
Quality  Assurance 

I  don't  have  to  be  what  you  want  me  to  be. 

•  Muhammad  Ali 

The  importance  of  quality  control  has  been  heightened  in  recent  times  by  the 
increasing  precision  of  manufacturing.  The  traditional  approaches  to  dimensional  in¬ 
spection  have  become  the  bottleneck  of  the  production  line.  [Menq,  et  aL,  1992a].  As 
a  result,  quality  control  has  evolved  from  a  trade  to  become  its  own  field  of  study  and 
has  received  recognition  as  a  separate  discipline  within  the  science  and  engineering 
communities.  New  dimensioning  and  tolerance  schemes,  through  the  application  of 
ANSI  standards,  have  defined  a  more  universal  method  of  defining  and  communicat- 
ing  engineering  intent  [Brown,  1983].  Measurement  methods  have  evolved  from 
manual  functional  gaging  into  highly  sensitive  probing  sensors  and  magnification 
optical  systems.  These  technologies  have  now  progressed  from  manually  driven 
procedures  into  automated  probing  robots  and  vision  systems  with  feature 
tecognidon. 

3,1.  Geometric  Dimensioning  and  Toierancing 

GD&T  is  a  means  of  dimensioning  and  toierancing  a  chawing  with  respect  to 
the  actual  function  or  relationship  of  pan  features  which  can  be  produced  most  eco- 
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comically  [Foster,  1986].  The  key  words  are  function  and  relationship.  GD&T  is  a 
system  of  building  blocks  designed  to  make  explicit  tolerance  requirements  that  oth¬ 
erwise  would  be  interpreted  only  by  implication.  GD&T  provides  the  designer  with  a 
clear  way  of  expressing  design  intent  and  pan  requirements  by  providing  a  relation¬ 
ship  between  the  toieranced  feature  and  the  datum  features  for  the  evaluation  of  the 
inspection  measurements.  This,  in  turn,  allows  the  inspector  to  choose  the  proper  co¬ 
ordinate  frame  in  which  to  inspect  the  part,  resulting  in  greater  evaluation  accuracy. 

GD&T  was  created  in  the  1950s  to  avoid  measurement  ambiguity  at  its  source 
—  when  the  drawings  are  made  and  the  tolerances  are  set  It  was  designed  as  a  stan¬ 
dard  to  help  the  inspectors  understand  and  interpret  the  designers'  meanings  behind 
the  tolerances  so  that  the  product  can  be  properly  inspected.  This  enhanced  dialog 
among  the  designers,  manufacturers,  and  inspectors  was  to  help  overcome  the  typical 
production  procedure  of  “throwing  the  drawings  over  the  wail”  for  the  next  group  to 
try  and  interpret.  GD&T  can  be  considered  in  the  same  sense  as  a  programmer  pro¬ 
viding  comments  as  he  develops  software  so  that  the  software  engineer  who  main¬ 
tains  the  code  (and  other  developers)  has  information  in  addition  to  just  the  code  it¬ 
self  in  order  to  understand  what  functions  the  code  is  supposed  to  perform. 

This  section  will  discuss  the  tolerances  of  GD&T,  grouped  together  by  the  type 
of  feature  from  which  they  are  called.  Table  1  shows  the  thirteen  GD&T  characteris¬ 
tics  and  symbols. 


Table  1.  Geometric  Dimensioning  and  Toierancmg  characteristics  and  symbols. 


Type  of  feature 

i 

Type  of  toler¬ 
ance 

Individual 

Form 

Individual  or 

related 

Profile 

Related 

Orientation 

(datum  reference 

required) 

Location 

Runout 

Symbol 


stnighmess 


cylindricity 


profile  of  a  surface 


angularity 


position 


circular  runout 


j  •  -r- 
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Basie  Dimensions 

A  basic  dimension  is  a  numerical  value  used  to  describe  the  theoretically  exact 
size,  profile,  orientation,  or  location  of  a  feature  target  It  has  no  tolerance  placed  on 
it  since  it  is  from  the  basic  dimensions  that  permissible  variations  are  established 
throughout  the  pan.  They  are  identified  by  the  word  3A5iC,  the  abbreviation  3 SC,  or 
placed  within  a  box. 


One  of  most  important  aspects  of  GD&T  is  the  material  condition  modifiers. 
These  modifiers  can  be  used  only  on  features  of  size  such  as  holes,  shafts,  pins,  and 
slots,  as  opposed  to  surface  features.  A  modifier  alters  the  tolerance  zone  of  a  toler¬ 
ance  callout  depending  on  the  feature's  actual  manufactured  size  versus  its  theoredcal 
size. 

The  most  common  material  condition  modifier  is  the  Maximum  Material 
Condition  (MMC,  8).  This  condition  occurs  when  the  feature  of  size  has  been 
manufactured  at  the  largest  or  smallest  allowable  toleranced  size  which  results  in  the 
maximum  material  stock  remaining.  Therefore,  a  hole  at  MMC  will  be  the  smallest 
allowable  size  within  tolerance  (minimum  diameter),  while  a  boss  at  MMC  will  be 
the  largest  allowable  size  within  tolerance  (maximum  diameter).  This  principle 
permits  a  relaxed  tolerance  value  (called  “bonus”  tolerance)  as  pan  feature  sizes  vary 
from  the  allowable  MMC  and  still  ensures  proper  feature  functionality.  At  MMC 
features  are  at  their  “tightest”  tolerance;  a  hole  is  at  its  smallest,  and  a  boss  is  at  its 
largest  As  these  features  drift  from  MMC  —  a  hole  gets  a  little  larger  and  a  boss 
gets  a  little  smaller  —  there  is  more  “play”  at  the  location  of  the  feature,  so  the  toler- 


ance  zones  are  allowed  to  increase  by  the  addition  of  the  bonus  tolerance,  yet  provide 
proper  functional  requirements.  The  amount  of  bonus  tolerance  awarded  is  equal  to 
the  distance  that  the  feature  drifts  from  MMC.  This  is  one  of  the  fundamental 
principles  on  which  Gb&T  is  based. 

Figure  6  illustrates  MMC  and  the  bonus  tolerance  condition  with  a  plate  and  its 
mating  part.  Figure  6(b)  shows  how  the  bonus  tolerance  of  the  hole  that  drifts  from 
MMC  allows  the  position  of  the  hole  to  vary  and  still  properly  connect  with  its  mat¬ 
ing  part. 


(a)  place  (top  view) 


bonus  tolerances 
atcm  qreacer 
flewWtty.  yet 
ensuring 
functionality 


(b)  piste  (Section  A-A) 


Figure  6.  Bonus  tolerances  provide  greater  function  flexibility. 


MMC  is  one  of  three  material  condition  modifiers.  The  others  are  Least 
Material  Condition  (LMC,  ©)  and  Regardless  of  Features  Size  (RFS,  ©).  LMC  also 
awards  bonus  tolerance  like  MMC,  only  in  the  opposite  fashion.  If  the  feature  of  size 
drifts  from  the  least  amount  of  material  stock  under  the  allowable  tolerance  range, 
then  the  bonus  is  awarded.  RFS  does  not  allow  any  bonus  tolerances,  and  the  toler¬ 
ance  value  is  constant  regardless  of  manufactured  feature  size. 
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D»nnm 

The  tolerances  in  GD&T  are  referenced  with  respect  to  datums.  A  datum  is  a 
theoretically  exact  point,  axis,  or  plane  created  from  the  true  geometric  measurements 
of  the  Hamm  callout  feature.  The  datums  define  the  origin  and  coordinate  reference 
frame  axes  from  which  the  location  or  geometric  characteristics  of  the  features  of  a 
pan  are  evaluated.  Being  theoretically  exact  means  that  all  the  surface  and  feature  in¬ 
accuracies  from  machining,  warping,  etc.  are  inherent  in  the  datum.  This  is  why  re¬ 
lational  tolerancing  is  stressed  so  highly  in  GD&T.  The  tolerance  evaluations  are 
based  on  the  their  relationship  to  the  datum  features,  e.g.,  what  feature  the  pan  will 
rest  upon,  what  axis  the  pan  will  spin  around,  or  what  flange  a  pocket  will  mate  with 
in  assembly. 

Fen 

mdstumd 


Figure  7.  Datum  callout. 


Datum  Reference  Frame 

The  datum  reference  frame  (DRF)  is  composed  of  three  mutually  perpendicular 
datums.  Selection  of  the  datums  is  made  by  the  functional  importance  of  the  features 
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and  their  relationship  to  the  datums.  How  the  product  is  constrained,  whether  fixed 
or  in  motion,  during  normal  operation  determines  the  datums. 

For  the  datum  planes  to  be  in  theoretically  perfect  normality  in  an  imperfect 
manufacturing  environment,  the  3-2- 1  convention  is  used.  This  refers  to  a  mathe¬ 
matical  formula  which  requires  three  points  on  the  primary  datum  (usually  the  resting 
surface),  two  inspection  points  on  the  secondary  datum,  and  one  point  on  the  tertiary 
datum  (Figure  8).  Since  three  non-coilinear  points  are  required  to  make  a  plane,  each 
least  significant  datum  uses  points  from  the  more  significant  datums  to  ensure  per¬ 
pendicularity.  More  technically  defined,  the  3-2-1  convention  is  a  systematic  method 
of  constraining  the  degrees  of  freedom  of  the  inspected  object.  The  datums  are  typi¬ 
cally  surfaces  but  can  also  be  axes  of  the  pan  geometry. 


six  decrees  of  freedom 


bottom  view;  3  left  view:  2  bade  view:  1 

highest  points  highest  points  highest  point 


Figure  8.  Creation  of  datum  reference  frame  using  3-2-1  convention  to  re¬ 
move  all  degrees  of  freedom  from  the  pan  model. 


An  independent  feature  is  a  single  surface,  element,  or  size  feature  which  re¬ 
lates  to  a  perfect  geometric  counterpart,  or  theoretically  perfect  copy,  of  itself  as  the 
desired  form.  There  are  no  datum  references  used  with  these  tolerances,  which  in¬ 


clude  straightness  (— ),  flatness  (P),  circularity  (O),  and  cylindricity  {ff). 

Straightness  is  a  condition  in  which  an  element  of  a  surface  or  an  axis  is  in  a 
straight  line.  The  straightness  tolerance  defines  two  different  tolerance  zones,  de¬ 
pending  on  the  feature  called  from.  Surface  straightness  defines  two  parallel  lines, 
distanced  apart  by  the  tolerance  value,  that  the  surface  element  must  lie  between. 
Axis  straightness  defines  a  cylindrical  tolerance  zone  for  the  axis  to  lie  within. 


Surfscs  straightness 


Callout: 


»  300 


4 


*1351 — ^  j, 


Axis  straightness 


0  300  *jOOB — 1 

I  ~  I  *-005  I 


Meaning: 


I 

a  ooo 


Figure  9.  Straightness  tolerance  callout  and  meaning. 


Flatness  is  the  condition  of  a  surface  having  all  elements  in  one  plane.  The 
flatness  tolerance  specifies  a  tolerance  zone  confined  by  two  parallel  planes  within 
which  the  entire  surface  must  lie.  The  tolerance  may  also  be  used  for  a  specified  area 
of  a  surface,  rather  than  the  entire  surface. 
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Callout: 


1 - 

|g  *  0.4 


^7  10061 


M earwig 


parallel  tinea 


-  -  'jXao 

Figure  10.  Flamess  tolerance  callout  and  meaning. 


Circularity  is  the  condition  on  a  surface  of  revolution  where  all  points  of  any 
given  cross  section,  taken  perpendicular  to  the  axis  of  a  cylinder  or  cone  or  through 
the  common  center  of  a  sphere,  are  equidistant  from  that  center.  The  tolerance  zone 
is  bounded  by  two  concentric  circles  within  which  the  actual  surface  must  lie. 


Callout: 


Meaning: 


.05  drcuiarrty  _ _ 

tolerance  zone  I 


Figure  11.  Circularity  tolerance  callout  and  meaning. 


Cylindricity  is  the  condition  of  a  surface  of  revolution  in  which  all  points  of  the 
surface  are  equidistant  from  a  common  axis.  The  tolerance  zone  is  bounded  by  two 
concentric  cylinders  within  which  the  toieranced  surface  must  lie.  The  cylindricity 
tolerance  simultaneously  controls  circularity,  straightness,  and  parallelism  of  the 
elements  of  the  cylindrical  surface,  since  it  covers  both  circular  and  longitudinal  ele¬ 
ments  of  the  toieranced  surface  at  the  same  dme. 
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Figure  12.  Cylindhcity  tolerance  callout  and  meaning. 


Related  features 

A  related  feature  is  a  single  surface,  element,  or  size  feature  which  relates  to  a 
datum,  or  datums,  in  form  and/or  orientation.  A  datum  or  datum  reference  frame 
must  be  included  in  the  feature  control  frame.  Related  orientation  tolerances  include 
perpendicularity  (±),  parallelism  (//),  angularity  {£).  Related  location  tolerances  in¬ 
clude  position  (♦)  and  concentricity  (O). 

Perpendicularity  (also  called  squareness  or  normality)  is  the  condition  of  a  sur¬ 
face,  median  plane,  or  axis  which  forms  exactly  a  90°  angle  to  a  datum  plane  or  axis. 
The  tolerance  zone  for  a  toleranced  surface  is  created  by  two  parallel  surfaces  that  are 
perpendicular  to  the  datum  surface  within  which  the  tolerance  surface  or  median 
plane  must  lie.  The  tolerance  zone  for  a  toleranced  axis  is  created  by  a  cylinder 
perpendicular  to  the  datum  plane  within  which  the  toleranced  axis  must  lie. 
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Callout:  Meaning: 


Figure  13.  Perpendicularity  tolerance  (surface)  callout  and  meaning. 

Parallelism  is  the  condition  of  a  surface  or  axis  which  is  equidistant  at  all 
points  from  a  datum  plane  or  axis.  When  a  surface  is  toleranced,  the  tolerance  zone 
is  defined  by  two  planes  parallel  to  the  datum  plane  between  which  the  toleranced 
plane  must  lie.  When  an  axis  is  toleranced.  the  tolerance  zone  is  defined  by  a  cylin¬ 
drical  tolerance  parallel  to  the  datum  axis  within  which  the  toleranced  axis  must  lie. 


Callout:  Meaning: 


Figure  14.  Parallel  tolerance  callout  and  meaning. 
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Angularity  is  the  condition  of  a  surface,  axis,  or  median  plane  which  forms  a 
specified  angle  (other  than  90°)  from  the  datum  feature.  The  tolerance  zone  is  cre¬ 
ated  by  two  parallel  planes  distanced  by  the  tolerance  value,  inclined  at  the  specified 
angle  from  the  datum  plane  or  axis,  and  within  which  the  toleranced  feature  must  lie. 


CaMoutt 


Meaning: 


Figure  15.  Angularity  tolerance  callout  and  meaning. 


Location  tolerances  state  the  permissible  variation  in  the  specified  location  of  a 
feature  in  relation  to  some  other  feature  or  datum.  They  define  a  zone  within  which  a 
center,  axis,  or  center  piane  of  a  feature  is  permitted  to  vary  from  true  position. 
Location  tolerances  include  position  (♦)  and  cylindricity  (O). 

True  Position  describes  the  exact  location  of  a  point,  line,  or  plane  of  a  feature 
in  relationship  to  a  datum  reference  or  other  feature.  The  position  tolerance  zone  is 
the  total  permissible  variation  in  the  location  of  a  feature  from  its  true  position.  For 
cylindrical  features  (holes  and  bosses),  the  tolerance  zone  is  a  cylinder  whose  diame¬ 
ter  is  the  tolerance  value  and  within  which  the  axis  must  lie.  For  other  features,  i.e., 
slots,  pockets,  etc.,  the  tolerance  zone  is  two  parallel  planes  separated  by  the  true 
position  tolerance  value,  within  which  the  surface  or  center  plane  must  lie. 

In  comparison  to  the  conventional  ±  tolerance  method.  GD&Ts  use  of  position 
tolerancing  provides  some  great  advantages.  First,  the  tolerance  zones  are  measured 
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from  the  datums  chat  are  functionally  relevant,  not  from  a  convenient  origin  as  with 
many  coordinate  tolerance  drawings.  These  datums  are  represented  in  the  Datum 
Reference  Frame  (DRF),  which  determines  the  coordinate  axes  frame  in  which  the 
parr  is  x  i/v  measure.*  cased  cui  how  u.e  in >etai.>  uie  p<ux  we  opoacu  or 

assembled.  Second,  the  tolerance  zone  is  more  accurate  and  actually  larger.  For  a 
toleranced  axis,  the  tolerance  zone  is  cylindrical,  not  square;  this  provides  an  area  in¬ 
crease  of  57%,  and  that  is  without  any  bonus  tolerances! 

VI-r-L4-x 


Figure  16.  GD&T  provides  a  greater  tolerance  area  with  a  circular  tolerance  zone. 

When  a  material  condition  modifier  is  placed  in  the  feature  control  frame  of  the 
position  tolerance,  feature  size  and  location  are  interdependent.  Bonus  tolerance  will 
be  added  when  the  feature's  size  varies  from  the  specified  material  condition  modi¬ 
fier. 
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Figure  17.  Bonus  tolerances  applied  to  the  material  condition  modifiers. 
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Concentricity  is  the  condition  in  which  the  axis  of  ail  cross-sectional  elements 
of  a  feature  s  surface  of  revolution  are  common  to  the  axis  of  a  datum  feature.  The 
tolerance  zone  is  a  cylinder  with  the  diameter  of  the  tolerance  value  within  which  the 
axis  must  lie. 


CaJJouC:  Mem** 
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3.2.  Computer -controlled  Inspection 

A  number  of  different  technologies  have  been  developed  to  automate  the  in¬ 
spection  process.  The  most  popular  have  been  vision  systems  and  coordinate  meas¬ 
urement  machines  (CMMs)  which  are  beginning  to  be  used  extensively  in  industry 
for  automatic  dimensional  inspection  of  products  [Etesami  and  Qiao.  1989].  The 
CMM  has  become  very  popular  due  to  new  technologies  increasing  its  speed  and  ac¬ 
curacy,  allowing  more  than  60  measurements  per  minute  with  accuracies  to  0.00001 
inch.  Therefore,  the  new  challenges  surrounding  CMMs  are  not  seen  in  the  act  of 
data  retrieval,  but  rather  the  planning  before  and  after  data  acquisition  and  retrieval 
—  where  to  take  the  inspection  measurements,  how  to  sequence  the  inspections  for 
efficiency,  and  how  to  evaluate  them  once  they  are  taken. 
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A  CMM  can  be  regarded  as  a  Cartesian  robot  whose  end-effector  is  a  contact 
probing  system  (Figure  19).  Its  task  is  to  perform  dimensional  measuring  by  touch¬ 
ing  the  surfaces  of  a  located  workpiece  and  reporting  an  accurate  location  based  on  a 
predetermined  origin.  The  original  CMMs  were  manually  operated,  displaying  one 
measurement  at  a  time.  Today's  CMMs  are  computer-controlled  and  driven  by  pro¬ 
grams  written  with  software  languages  that  represent  an  entire  workpiece  inspection. 
Many  of  the  computer  controllers  will  also  evaluate  the  measurement  data  and  answer 
“yes/no”  as  to  whether  the  pan  is  within  tolerance. 

As  is  the  case  with  any  new  technology,  there  are  both  advantages  and  disad¬ 
vantages.  CMMs  have  produced  time  and  labor  savings  by  replacing  some  classical 
approaches  such  as  open  set-up  and  hand-tool  dimensional  inspection  techniques 
which  are  costly,  inherently  slow,  less  accurate,  and  subject  to  inspector  error.  The 
primary  benefits  of  the  CMM  are  its  reduced  setup  time,  greater  accuracy,  depend¬ 
ability  and  repeatability,  and  automatic  operation.  However,  CMMs  are  initially  very 
expensive.  Even  after  a  significant  amount  of  use,  CMMs  require  a  skilled  pro¬ 
grammer  with  a  quantity  of  time  allocated  for  each  job.  A  shop  with  many  small  lots 
may  not  see  a  time  benefit  from  the  CMM  due  to  the  programming  and  process 
planning  time  required. 
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coordinate  m«jsurmerrc  machine  (CMM) 

Figure  19.  Coordinate  measurement  machine. 


3.3.  Automated  Inspection 

The  inspection  tools  mentioned  above,  GD&T  and  CMMs,  have  enhanced  the 
ability  of  the  Quality  Assurance  engineer  to  inspect  manufactured  products. 

However,  the  tools  have  introduced  their  own  problems  that  must  be  solved.  First,  a 
new  dimension  has  been  added  to  creating  the  process  plan.  Not  only  must  the  toler¬ 
ances  be  measured  correctly,  but  measurement  instructions  must  be  translated  into 
CMM  instruction  code  to  automadcaily  inspect  the  product  efficiently  and  safely. 

Second,  the  two  tools  are  not  collaborating,  i.e.,  one  is  not  complementary  to 
the  other.  GD&T  is  based  on  hard  gaging,  a  technique  that  uses  surface  piates.  plugs. 
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gage  pins,  perpendiculars,  functional  gages,  etc.  CMMs  do  not  measure  in  the  same 
way  as  these  hard  gages  do,  and  therefore  produce  different  results.  CMMs  measure 
by  single-point  measurements  and  a  mathematical  averaging  to  create  virtual  features. 
For  exaxupic,  a  CNilvl  *  ill  measure  Uusc  on  a  ua*mii  surface.  A  aatucaaaacal 

algorithm  will  take  those  three  points  and  construct  the  normal  for  a  virtual  plane 
which  will  represent  the  actual  datum  from  which  all  other  measurements  will  be 
compared.  Unless  the  three  measured  points  were  the  highest  three  points  on  the  ac¬ 
tual  surface,  the  virtual  plane  is  going  to  be  incorrect  both  in  position  and  (mentation. 
A  surface  plate  is  guaranteed  to  pick  up  the  highest  three  points  that  will  become  the 
datum. 

Two  approaches  can  be  applied  to  overcome  this  deficiency  and  “marry”  the 
two  techniques  together.  In  the  first  approach,  the  CMM  is  used  to  meet  hard  gaging 
requirements  of  GD&T.  For  example,  the  inspector  would  use  a  gage  pin  or  surface 
plate,  and  then  measure  the  inspection  points  from  the  gage  using  the  CMM. 
However,  the  extensive  user  time  involved  would  defeat  the  speed  of  the  computer- 
controlled  CMM,  and  other  cheaper  machines  could  be  used. 

In  the  second  approach,  the  GD&T  standard  is  enhanced  so  that  the  benefits  of 
the  computer-controlled  CMM  can  be  realized.  A  Y14  Ad  Hoc  Mathemanzanon 
Committee  and  the  ANSI/A SME  B  89.3 .2  committee  have  been  established.  These 
committees  are  working  on  “mathemanzing”  the  current  Y14_5  standard  [Schreiber. 
1990].  This  task  includes  establishing  unambiguous  mathematical  definitions  of  toi- 
eranc'i  g  and  sampling  procedures  based  on  features  and  processes. 

To  illustrate,  the  diameter  of  a  hole  feature  should  be  measured  differently  than 
the  diameter  of  a  boss  feature  because  each  feature  has  a  different  function.  For  a 
hole,  the  minimum  inscribed  radius  is  desired  because  a  mating  boss  has  to  fit  into  it 
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and  can  only  be  as  large  as  the  minimal  radial  separation.  Using  a  hard  gage  will 
automatically  provide  this  value.  For  a  boss,  the  maximum  circumscribed  radius  is 
desired.  However,  most  CMMs  now  use  a  least  squares  averaging  algorithm  for  both 
features,  which  can  even  be  viewed  as  functionally  incorrect. 

Evaluation  Method 


O  Maximum  inscribuk  hote 

Circumscribed:  boM 
^  least  Squares:  QMAs 


Figure  20.  Three  different  evaluation  results  based  on  the  same  inspection  points. 


Chapter  4 

Inspection  Planning  and  Evaluation 
Module 

Nothing  is  so  commonplace 
as  to  wish  to  be  remarkable 

-  Oliver  Wendell  Holmes 


Process  planning  is  defined  as  the  act  of  preparing  a  detailed  plan  for  the  pro¬ 
duction  (i.e.,  manufacturing,  inspection)  of  a  part  or  assembly  [Brown,  1983]. 
Process  planning  requires  a  significant  amount  of  both  time  and  experience. 
According  to  an  Air  Force  study,  a  typical  process  planner  is  a  person  over  40  years 
of  age  with  significant  experience  in  a  machine  shop  [Chang  and  Wysk,  1985].  Most 
experts  agree  that  process  planning  is  not  an  exact  science,  but  is  more  of  an  an 
gained  from  yean  of  experience.  The  automation  of  process  planning  would  provide 
significant  aid  to  the  job  shop.  With  automated  process  planning,  the  learning  curve 
of  new  engineers/technicians  could  be  shortened  and  their  productivity  could  be  in¬ 
creased.  The  experienced  process  planners  could  focus  their  attention  onto  the 
unique  problems  that  arise,  allowing  the  automated  system  to  plan  for  the  routine 
recurrent  operations.  According  to  Chang  and  Wysk  (1985),  the  advantages  of 
computer-aided  process  planning  are: 

•  It  can  reduce  the  skill  required  of  a  planner. 

•  It  can  reduce  the  process  planning  time. 


J/ 
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•  It  can  reduce  both  process  planning  and  [inspection]  costs. 

•  It  can  create  more  consistent  plans. 

•  It  can  produce  more  accurate  plans. 

•  It  can  increase  producdvity. 

A  parallel  to  inspection,  automated  manufacturing  planning  systems  have  re¬ 
ceived  much  attention  from  research  and  industry  over  the  past  20  years  [Westhoven, 
1991].  Hayes  (1990)  names  22  automated  manufacturing  process  planners. 
However,  automated  process  planning  for  inspection  is  relatively  new  [Traband  and 
Medeiros,  1988].  Brown  (1983)  describes  three  automated  inspection  systems  and 
also  states  that  “documented  efforts  toward  automating  computer  aided  process 
planning  for  inspection  have  been  few,  especially  in  comparison  to  the  CAPP  efforts 
directed  toward  manufacturing  the  pan.” 

An  inspection  process  plan  would  include  the  detailed  sequence  of  events  to 
successfully  satisfy  inspection  evaluation.  These  events  include: 

•  describe  pan  orientations  to  access  inspection  points 

•  locate  pan  on  inspection  table  (create  pan-model  coordinate  frame) 

•  inspect  and  create  DRF  coordinate  frame 

•  inspect  feature  tolerances  using  proper  methods  far  tolerance  callout 

•  evaluate  measurements 

•  report  results  to  the  human  inspector 

•  prepare  for  the  next  measurement  in  an  efficient  and  safe  manner 
The  events  can  be  in  the  form  of  printed  instructions  for  manual  inspection,  or  the 
form  of  code  that  can  be  executed  by  automated  inspection  equipment  to  perform  the 
inspection  plan  [Merat,  et  ai.,  1991]. 


IPEM  Overview 

The  IPEM  can  be  described  by  two  pans:  the  process  planner  and  the  CMM 
code  generator.  The  inspection  planner  translates  the  design/tolerance  feature  combi¬ 
nations  and  pan-model  geometry  into  a  suitable  form  for  the  code  generator.  Section 
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4. 1  describes  the  work  of  the  IPEM  research  team  on  the  process  planner.  Sections 

4.2  and  4.3  describe  the  individual  work  accomplished  that  created  this  thesis:  the 
automated  CMM  code  generator.  This  includes  three  main  efforts: 

1.  an  artificial  neural  network  to  ensure  an  intelligent  scheduling  of  measure¬ 
ment  points  based  on  a  set  of  inspection  rule  criteria  (section  4.2^), 

2.  a  collision  avoidance  algorithm  using  computationally  efficient  path-gen¬ 
eration  methods  (section  4.32),  and 

3.  the  inspection  plan  translation  into  CMM  code,  structured  into  a  format 
the  inspector  can  understand  and  interpret  easily  (section  4.3.4). 

Figure  21  diagrams  the  algorithm  of  the  DPEM.  The  boxes  with  the  black  shadow, 

rather  than  gray,  are  the  areas  of  individual  effort  accomplished  for  this  thesis. 


Figure  21.  IPEM  algorithm. 
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4.1.  Automated  Inspection  Process  Planning 

The  function  of  the  automated  process  planner  in  the  IPEM  is  to  input  the  de¬ 
sign  features,  consisting  of  geometry  and  tolerance  features,  and  to  output  an  inspec¬ 
tion  plan  representation  which  serves  as  a  template  for  the  final  inspection  plan  form 
—  CMM  code.  The  output  plan  is  defined  by  a  set  of  hierarchical  structures  consist¬ 
ing  of  setup/datum  reference  frame/tolerance  measurement  objects.  This  structure 
characterizes  the  GD&T  standard  sequence  of  events  to  take  place  in  the  inspection 
process.  This  sequence  includes  four  main  operations: 

•  orient  and  locate  pan  in  proper  setup 

•  create  virtual  coordinate  frame 

•  measure  tolerances 

•  evaluate  measurements 

The  process  of  creating  this  sequence  of  events  to  inspect  the  workpiece  is  called  in¬ 
spection  plan  sequencing  throughout  this  woric. 

4.1.1.  CAD  Feature  Translation 

This  thesis  has  emphasized  the  importance  of  features  used  not  only  as  geome¬ 
try  representation,  but  also  as  the  common  link  between  the  different  engineering 
modules.  Within  the  FBDE,  new  tolerance  features  are  checked  by  constraint  man¬ 
agers  for  appropriateness  as  defined  by  GD&T  convention.  For  example,  a  circular¬ 
ity  tolerance  feature  cannot  be  placed  on  a  pocket  design  feature.  A  constraint 
violation  is  defined  consisting  of  “Y”  for  appropriate,  “NS”  for  non-standard  but 
acceptable,  and  “NA”  for  not  appropriate.  Presently,  the  designer  can  override  the 
constraint  violations  and  place  any  tolerance  on  any  design  feature. 
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Table  2.  Allowable  designAolerance  feature  combinations  within  the  IPEM. 
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The  IPEM  process  planner  begins  by  accessing  design  and  tolerance  informa¬ 
tion  created  in  the  FBDE  and  represented  as  features.  The  designAolerance  feature 
combinations  are  checked  for  current  implementation.  Since  the  EPEM  is  a  research 
project,  not  everything  is  complete.  Combinations  that  have  not  yet  been  imple¬ 
mented  are  simply  noted  to  the  user  as  incomplete. 

Feature  translation  takes  the  combination  of  a  tolerance  feature  and  the  design 
feature  from  which  it  is  called  and  creates  the  inspection  features.  This  first  type  of 
inspection  feature  is  referred  to  as  “inspection  plan  fragment”  objects  (IPFs).  IPFs 
signify  a  segment  of  the  total  inspection  plan.  This  translation  is  unique  in  that  it  is 
the  only  feature  translation  within  the  IPEM  that  has  a  1:1  ratio,  i.e.,  each  de- 
sign/tolerance  combination  is  translated  into  exactly  one  IPF. 

The  next  task  is  to  determine  what  surfaces  the  design/tolerance  feature  combi¬ 
nation  requires  to  be  measured.  Since  features  have  muidple  surfaces,  a  different  set 
of  surfaces  will  need  to  be  measured  depending  on  the  tolerance  callout  (Figure  221. 
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Inspection  rules  operate  upon  the  IFF  objects  to  specify  the  actual  surfaces)  to  be 
measured.  This  operation  creates  a  new  inspection  feature  called  the  “measurement 
request”  (MR). 


Mind  h oie  design  feature 


position  tolerance  callout  flatnese  tolerance  callout 

Figure  22.  Each  design/tolerance  feature  combination  specifies  a  set  of  sur¬ 
faces  to  be  measured. 

The  translation  of  an  IPF  to  an  MR  is  not  a  1:1  transiadon  because  there  may 
be  more  than  one  tolerance  per  surface.  When  this  occurs,  the  measurement  points 
from  one  tolerance  can  often  be  used  in  a  different  mathematical  interpretation  to 
evaluate  a  different  tolerance.  For  example,  a  datum  plane  could  also  have  a  flatness 
tolerance  callout  The  planar  surface  has  two  IPFs,  i.e.,  two  different  tolerances  (the 
datum  and  the  flatness).  The  inspection  plan  needs  only  one  measurement  request 
but  two  evaluation  requests  since  the  same  inspection  points  measured  for  the  datum 
plan  can  be  used  for  the  flatness  tolerance.  This  eliminates  any  redundant  measure¬ 
ments  of  surfaces. 

The  MR  is  the  feature  class  that  will  be  extensively  used  by  the  IPEM  for  in¬ 
spection  process  planning.  This  class  is  broken  down  into  two  types  of  MRs:  inde¬ 
pendent  (MRj)  and  related  (MRr).  MR}$  contain  independent  tolerances  and  MR^ 
contain  related  tolerances,  i.e.,  tolerances  dependent  upon  datums  or  a  DRF  (section 
3.1).  Knowledge  rules  generate  the  inspection  plan  by  sequencing,  optimizing,  and 
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translating  the  MRs  based  upon  3-D  geometric  reasoning,  inspection  rales,  and  A1 
heuristics. 

4.1.2.  Structure  Setup  ir.i  Prs-plin  Geometric  Reasoning 

Once  the  MRs  are  created  from  design  and  tolerance  feature  translations,  the 
IPEM  can  begin  to  plan  for  the  inspection  plan  sequencing.  The  inspection  plan 
structure  is  represented  by  the  sequence  hierarchy  of  semp-DRF-MR.  This  notanon 
refers  to  setup  objects  as  patents  of  DRF  objects,  winch  ate  parents  of  MR  objects. 
Using  the  CLOS  class  paradigm  allows  inheritance  of  properties  from  parent  to  child. 
For  example,  the  inspection  points  of  the  child  MR  inherit  the  rotation  matrix  from  a 
property  within  the  setup  parent  which  properly  orients  the  points  within  that  setup. 

Ombi  Reference  i  nine 

Mumocb  ReqoMt 

Vktecodc 


Figure  23.  Inspection  pian  hierarchy. 
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The  Setup  Object 


The  setup  object  describes  the  orientation  of  the  workpiece  on  the  CMM  table. 

It  contains  two  important  elements:  the  resting  surface  of  the  workpiece,  and  the  ori¬ 
entation  information,  described  by  the  angles  needed  to  rotate  the  workpiece  from  the 
designer's  original  orientation  used  in  the  CAD  system  into  the  orientation  of  the 
setup.  The  angles  create  the  rotation  matrix,  R.  They  are  defined  by  a  mathematical 
standard  procedure  for  graphical  rotations  to  place  an  object  into  an  arbitrary  orienta¬ 
tion.  The  procedure  is  similar  to  Euler's  angles  or  roll-piich-yaw  angles  which  con¬ 
dense  the  rotation  matrix  into  independent  variables  only  by  removing  redundant 
information.  The  rotation  matrix  is  then  defined  by  an  algorithm  performed  cm  the 
independent  variables.  In  the  procedure  used  by  this  research,  the  rotation  matrix  is 
defined  by: 

X(*.9,V)-Ry(*)llt'l9)Rr(v)  (4.1) 

where  the  individual  rotations  are: 


Me)= 


c*  0 

*1 

0  1 

o  ! 

i 

~st  0 

['  • 

0  1 

0  Cq 

-*l 

* 

c9  j 

(4.2) 


(4.3) 


Cy  —Sy  0  | 

^4 f  ^  i 

o  o  i  i 


(4.4) 


45 


with  shorthand  notations  cx  =  cos(x)  and  jx  =  sin(x).  Since  matrix  multiplication  is 
not  commutative,  the  matrices  must  be  multiplied  in  the  order  of  equation  (4.1). 

Pre -denned  functions  make  this  easy  to  do  in  LISP.  For  example,  to  create  a  point. 


.z?,  ir.  the  ne'T  :cxp  coordinate  iam*  with  o* 


J  * 


... om  u.v  p  jut., a 
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code  would  be: 


(setf  ry  (calculate-rocation-tnatrix  0.0  y  0.0)) 

(a«t£  rx  (calculate-rotation-matrix  x  0.0  0.0)) 

(setf  rz  (calculate-rotation-matrix  0.0  0.0  z) ) 

(setf  x2  (raultiply-vector-and-matrix  xl  ry) ) 

(setf  x2  (multiply-vector-and-matrix  x2  rx) ) 

(setf  x2  (multiply-vector-and-matrix  x2  rz)) 

Figure  24  shows  how  coordinate  frame  xyz  is  rotated  into  its  setup  orien canon 
by  three  ordered  rotations  about  the  axes  y,  x\  and  z".  Each  rotation  represents  one 
element  of  the  R  matrix. 


Figure  24.  Three  consecutive  axes  rotations. 


The  DRF  object  describes  a  virtual  coordinate  frame  in  its  parent  setup  object. 
The  coordinate  frame  is  defined  by  the  GD&T  3-2-1  convention  of  three  mutually 
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perpendicular  datums  (Figure  8  on  page  25).  Therefore,  the  MRs  of  the  three  datums 
are  contained  in  the  DRF  object.  The  DRF  type  is  also  stored  as  a  property.  DRF 
type  is  the  concatenation  of  the  three  datum  types,  which  refers  to  whether  the  datum 
is  a  plane  or  axis,  represented  as  P  or  A,  respectively.  The  most  common  DRF  type 
is  PPP,  three  planes.  Another  common  type  is  PAP  or  PPA,  where  an  axis  and  two 
planes  constrain  the  pan  to  zero  degrees  of  freedom.  This  information  is  used  by  the 
output  code  generator  to  determine  where  the  origin  lies.  If  the  DRF  is  of  type  PPP, 
then  the  origin  is  the  intersection  point  of  the  three  planes;  otherwise,  an  algorithm 
must  be  used  based  on  the  position  of  the  axis  datum  (section  4.3.2). 


PAP  or  Pf A  type  of  DRF 

ima 


7  piane 

Figure  25.  Datum  creation  within  a  DRF  that  contains  an  axis  datum 


The  Measurement  Request  Object 


As  described  above,  the  MR  inspection  feature  is  translated  from  the  design  and 
tolerance  feature  combinations  of  the  FBDE  via  the  IFF.  Obviously,  the  properties  of 
the  MR  contain  the  tolerance  and  feature  types  and  the  set  of  surfaces  to  be  measured. 
However,  before  inspection  pian  sequencing  can  occur  (determining  the  proper  work¬ 
piece  orientations  and  tolerance  sequence  within  the  inspection  plan),  more  geometry 
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information  is  needed.  Fust,  inspection  rules  place  measurement  points  on  the  toler¬ 
ance  d  surfaces.  The  rules  determine  how  many  points  and  what  constraints  are  re¬ 
quired  to  properly  evaluate  the  design/tolerance  feature  combination  of  the  MR 
(Table  3).  For  example,  to  create  a  datum,  at  least  tnree  non-cotiinear  points  must  be 
measured. 

Table  3.  Inspection  point  constraints  on  placement  based  on 
design/tolerance  feature  combinations. 


Design 

feature 

Tolerance 
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Number  of 
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(min.  default) 
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perp.i. 
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bi-plane,  tri-plane- 120 

circ.  O 

3,4 

planar,  planar- 120 

surface 

perp.J. 

3,5 

non-collinear 

3 

non-collinear.  RHRuo 

1  Nwailaf  tbtc 


Pre-plan  Geometric  Reasoning 

The  goal  of  the  pre-plan  geometric  reasoning  is  to  create  ail  the  allowable 
setup-DRF-MR  object  combinations,  and  then  use  AI  heuristic  searches  to  remove 
the  redundant  measurement  structures.  The  approach  is  first  to  create  the  set  of  all 
possible  setup  objects,  then  to  place  the  MRs  into  their  proper  DRF  object,  and 
finally  to  place  the  DRF-MR  structure  into  each  allowable  setup  object  based  on  in¬ 
spection  point  visibility. 


An  extensive  amount  of  geometric  reasoning  is  used  to  prepare  for  setup  object 
instantiation.  The  setup  objects  are  instantiated  from  the  stable  surfaces  of  the  part. 
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The  stable  surfaces  are  a  sub-set  of  the  exterior  surfaces.  The  exterior  surfaces  are 
distinguished  from  ail  other  types  of  surfaces  of  the  solid  pan-model  by  two  tests. 

The  first  test  determines  a  surface  is  planar  by  checking  for  constant  normals  across 
the  surface.  Then  offset  surfaces  are  created  on  each  side  of  the  planar  sun  ace  and 
“grown”  within  their  plane  to  values  greater  than  the  known  maximum  dimensions  of 
the  pan- model.  If  one  of  the  offset  surfaces  does  not  intersea  the  pan  model,  the 
original  surface  is  determined  as  the  external  surface. 


One  “qrotm"  offset  plane  does 


Figure  26.  Growing  offset  surfaces  to  determine  for  internal  or  external  status. 


The  external  surfaces  then  are  the  candidates  for  resting  surfaces  of  a  possible 
pan  setup  orientation.  A  stability  test  using  a  convex-hull  algorithm  [Preparata  and 
Hong,  1977]  selects  which  exterior  surfaces  can  support  the  workpiece  without  the 
use  of  fixtures.  Since  fixtures  require  extra  time  and  effort,  make  it  hard  to  produce 
repeatability,  and  pose  special  threats  in  the  form  of  probe  collision  problems,  the 
stable  resting  surfaces  are  preferable  to  the  inspector. 
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Figure  27.  Convex  hull  results. 


Preariny  the  S«niP-DRF-MR  Objects 

Each  stable  resung  surface  corresponds  to  one  setup  instantiation.  The  setup 
object  is  populated  with  the  proper  setup  onentahon  matrix  and  stable  resting  surface. 

Two  GD&T  guidelines  are  used  to  create  the  proper  DRF-MR  structures. 

Since  the  MRr  (MR  with  related  tolerance)  is  defined  by  GD&T  to  be  inspected  in  its 
DRF  coordinate  frame,  the  MRr  object  is  simply  placed  into  the  slot  of  the  DRF 
specified  from  its  related  tolerance  callout.  However,  the  MR;  can  be  measured  in 
any  coordinate  frame;  therefore,  they  are  placed  initially  into  every  DRF. 

The  DRF-MR  structures  are  now  added  to  any  appropriate  setup  object  The 
setup-DRF-MR  structure  is  deemed  appropriate  by  testing  for  inspectability,  meaning 
that  the  measurement  points  on  the  surface  to  be  inspected  can  be  reached  safely  by 
the  CMM  probe  with  the  pan  in  its  setup  orientation.  The  inspectability  criterion  is 
determined  by  a  two-fold  test:  visibility  and  accessibility. 
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Figure  28.  Viability  and  accessibility  tests  piece  each  inspection  point  into  a 
setup  orientation. 

Visibility  precedes  the  accessibility  test  since  it  is  less  computationally  expen¬ 
sive.  Visibility  checks  for  a  collision-free  2-D  line  originating  at  the  inspection  point, 
proceeding  in  the  direction  of  the  resting  surface  normal,  and  tenmnanng  at  the  off¬ 
set-plane  safely  above  the  part.  The  point  is  determined  to  be  visible  if  the  2-D  line 
does  not  intersea  the  pan-model.  If  the  inspection  point  is  visible,  Le.,  the  visibility 
test  returns  true,  then  the  accessibility  test  is  executed.  Actual  CMM  probe  geometry 
and  dimensions  are  used  to  check  for  possible  probe  head  collisions  (intersections) 
with  the  pan-model  when  making  the  measurement.  If  ail  inspection  points  within  an 
MR  pass  both  visibility  and  accessibility  tests,  then  that  MR  is  placed  in  the  setup. 

4.1.3.  Plan  Sequencing 

In  a  generic  sense,  inspection  plan  sequencing  determines  the  setup  orientations 
within  the  inspection  p*an  and  the  DRJF  ordering  within  the  setups.  In  a  specific 
sense,  inspection  plan  sequencing  reduces  the  set  of  redundant  setup-DRF-MR  struc- 
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tures  into  a  concise,  unique  inspection  plan.  The  goal  is  to  minimize  the  number  of 
setups,  since  each  new  orientation  requites  inspector  interaction  in  pan  relocation  and 
possible  fixturing. 

The  plan  sequencer  consists  of  two  sub-processes:  ordering  setups,  and  order¬ 
ing  MRs  within  a  setup.  This  two-step  sequencing  is  analogous  to  a  global  ordering 
and  a  local  ordering,  respectively.  In  global  ordering,  the  goal  is  to  find  the  mini¬ 
mum  number  of  setups  for  complete  inspection  of  the  workpiece.  The  algorithm 
searches  for  and  begins  with  the  setup  object  containing  the  largest  number  of  MRs 
in  its  setup-DRF-MR  structure.  All  identical  MRs  from  the  other  setup  objects  are 
then  eliminated  from  their  duplicate  setup  objects.  This  process  will  result  in  some 
setups  losing  all  their  MRs,  and  thus  that  entire  empty  setup-DRF-MR  structure  is 
eliminated  from  the  original  set.  The  setup  with  the  next  largest  number  of  total  MRs 
is  chosen  and  the  process  is  repeated  until  no  redundant  MRs  exist  in  the  setup-DRF- 
MR  structures.  At  the  conclusion  of  this  process,  the  inspection  plan  contains  the 
minimum  number  of  setups  with  no  redundant  measurements. 

Local  ordering  involves  proper  sequencing  of  DRFs  within  each  setup  based  on 
tolerance  relationships  to  datums.  The  presence  of  related  datums  in  the  definidon  of 
the  DRF  establishes  the  sequencing  criteria.  For  example,  a  PAP  (plane,  axis,  plane) 
DRF  type  will  often  have  a  position  callout  of  the  secondary  axis  datum  which  is  re¬ 
lated  to  a  PPP  DRF  also  in  that  setup.  Therefore,  according  inspection  technique 
logic,  the  PAP  and  its  related  axis  datum  must  be  measured  after  the  PPP  DRF  upon 
which  it  is  dependent 

The  result  and  output  of  the  inspection  plan  sequencer  is  an  inspection  plan 
representation  consisting  of  a  minimized  number  of  setups  with  stable  resting  sur¬ 
faces,  proper  sequencing  of  dependent  tolerances,  and  eliminated  redundant  tolerance 
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measurements.  The  next  step  is  to  translate  this  inspection  plan  representation  into 
commands  for  the  CMM  probe  travel  and  measurement  evaluation  to  determine  if  the 
workpiece  has  been  manufactured  within  tolerance. 

4.2.  Intelligent  Scheduling  Optimization 

The  previous  section  discussed  how  the  IPEM  creates  the  inspection  plan  by 
first  creating  the  set  of  all  allowable  serup-DRF-MR  structures  using  two  measure¬ 
ment  point  criteria:  visibility  and  accessibility.  Heuristic  algorithms  then  remove  die 
redundant  MRs  and  sequence  the  remaining  MRs  within  the  DRF  objects  according 
to  their  datum  dependencies.  Notice  that  the  criteria  for  ordering  the  MRs  within  the 
DRFs  and  the  inspection  points  within  the  MRs  is  a  singular  criterion  based  upon  ori¬ 
entation  only;  relative  position  is  not  considered.  In  addition,  the  measurement  points 
are  positioned  on  the  tolerance  surface  randomly,  with  constraints  testing  the  validity 
of  the  placement  (Table  3  on  page  47).  Therefore,  the  order  of  points  within  the 
current  inspection  plan  representation  has  absolutely  no  meaning!  The  next  task  of 
the  EPEM  optimizes  the  path  trajectory  of  the  CMM  probe  by  ordering  the  offset 
points  throughout  the  DRF  and  MR  objects.  However,  it  is  not  enough  to  lump  ail 
the  points  within  a  setup  together  and  optimize  based  solely  on  distance.  The 
ordering  of  the  offset  points  within  the  inspection  plan  needs  to  follow  three 
inspection  criteria: 

Criterion  1:  GD&T  rules  of  tolerance  evaluation  must  be  met. 

Criterion  2:  the  plan  should  be  executed  in  a  safe  and  efficient 
manner. 


Criterion  3:  the  plan  needs  to  be  understandable  to  the  inspec¬ 
tor,  especially  since  it  will  be  automatically  gen¬ 
erated  and  the  inspector  must  then  interpret  it. 

This  style  of  optimization  problem  resembles  the  Traveling  Salesman  Problem 
(TSP)  which  is  one  of  the  most  widely  studied  combinatorial  optimization  problems 
[Laporte,  1992].  Several  other  permutadon  problems  can  also  be  described  as  TSP 
when  the  distance  criterion  is  changed  to  a  cost  function  to  be  minimized:  computer 
wiring,  wallpaper  cutting,  hole  punching,  job  sequencing,  dan  board  design, 
crystallography,  etc.  These  research  thrusts  have  created  several  solution  approaches 
based  on  the  desired  result.  Solution  methods  range  from  sequential  to  parallel,  and 
exact  to  approximate.  Sequential  methods  are  implemented  heurisdc  searches  which 
look  throughout  the  solution  space,  one  permutation  at  a  time.  Parallel  methods  util¬ 
ize  neural  networks,  which  have  caused  the  area  of  neural  networks  to  recently 
undergo  a  resurgence  in  research  activity. 

This  section  utilizes  the  computation  methods  of  the  TSP  to  provide  solutions 
that  meet  the  criteria  of  inspection  planning.  Both  the  heuristic  search  and  neural  net¬ 
work  approaches  are  implemented  within  the  IPEM.  The  heuristic  search  method  im¬ 
plements  the  nearest  neighbor  algorithm  with  a  two- level  hierarchical  search  modifi¬ 
cation.  The  artificial  neurai  network  implementation  uses  a  Hopfield  nerworic  for 
optimization  with  an  inspection  rule  generated  cost  function  modification.  However, 
each  method  requires  a  different  inspection  plan  structure  which  significantly  effects 
the  operations  of  the  automated  code  generator. 
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Plan  S  true  lures  Dictated  bv  Point  Order 

All  automated  inspection  plans  require  a  specific  format  to  properly  inspect  the 
workpiece.  The  CMM  instructions  must  contain  the  following  modules  in  order 

1.  instruct  the  inspector  to  place  the  workpiece  in  the  inidal/nexr  setup  to 
inspect  flNIT] 

2.  instruct  the  inspector  to  locate  the  workpiece  by  manual  inspection,  creat¬ 
ing  the  local  coordinate  frame  [SETUPaj 

3.  (optional)  re-measure  the  local  coordinate  frame  automatically  for  better 
accuracy  (SETUPb) 

4.  if  different  than  the  initial  coordinate  frame,  measure  the  datums  and 
mathematically  create  the  next  DRF  [DRF] 

5.  measure  a  tolerance  within  that  DRF  [MR) 

6.  show  evaluations  when  the  measurement  is  completed  [EVAL] 

.  7.  return  to  1  if  there  exists  a  next  setup;  otherwise,  end  [DONE?) 

However,  there  are  three  flow  possibilities  that  provide  various  degrees  of  efficiency 
versus  readability  in  the  resultant  automated  inspection  plan.  Each  flow  possibility  is 
the  result  of  the  criteria  used  to  sequence  the  inspection  points. 


Figure  29(a)  shows  CMM  instruction  command  structure  if  the  two-level 
nearest-neighbor  sequence  algorithm  is  used  (section  4.2.1).  Its  advantage  is 
inspector  readability.  Each  tolerance  evaluation  is  performed  directly  after  the 
measurements  are  taken,  and  all  measurements  of  an  MR  are  performed  together. 
This  is  advantageous  for  small  lots  of  different  workpieces. 

Figures  29(b)  and  (c)  show  the  command  structure  of  using  the  ANN  schedul 
mg  (section  4.22)  where  the  inspection  points  among  the  different  MRs  are 
intermixed  within  the  inspection  p*an  schedule.  The  evaluation  command  cannot 
occur  until  all  its  inspection  points  have  been  probed.  Figure  29(b)  shows  the  least 
difficult  way  for  the  IPEM  to  generate  the  code,  but  it  is  also  less  efficient.  In  this 
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scheme,  ail  the  inspection  points  are  probed  and  saved  into  memory.  Then  all  the 
evaluations  occur,  each  evaluadon  function  retrieving  the  proper  measurements  from 
memory.  This  makes  it  hard  for  the  inspector  to  interpret  the  automated  inspection 
plan.  This  is  advantageous  for  large  lots  of  the  same  workpiece. 

Figure  29(c)  shows  the  more  efficient  way  to  perform  the  command  structure. 
An  evaluation  is  performed  after  a  successful  check  is  made  to  see  if  ail  the  inspec¬ 
tion  points  needed  to  perform  the  evaluation  have  been  previously  measured.  This 
provides  immediate  analysis  of  the  tolerances  on  the  manufactured  part.  One 
advantage  is  that  when  the  tight  or  critical  tolerances  are  measured  first,  the 
inspection  plan  can  be  terminated  and  cease  performing  unnecessary  measurements. 
For  example,  if  a  datum  is  out  of  position  tolerance,  then  ail  the  points  that  reference 
that  datum  cannot  be  measured  properly.  Once  the  datum  is  evaluated,  the  CMM 
program  can  stop  the  plan  and  prompt  the  inspector  to  continue. 

4.2.1.  Heuristic  Search  Scheduling 

Broadly  speaking,  optimization  searching  heuristics  can  be  called  tour  construc¬ 
tion  procedures  which  gradually  build  a  solution  by  adding  a  new  vertex  at  each  step 
based  on  a  ore -defined  criterion  [Laporte,  1992],  The  solution  methods  can  be  classi¬ 
fied  into  exact  and  approximate  searching.  The  algorithm  for  exact  solutions 
searches  the  entire  solution  space,  applying  the  criterion  heuristic  to  all  allowable 
solution  combinations  and  then  selecting  the  best  result  once  the  entire  space  is 
searched.  This  approach  requires  unreasonable  time  and  memory  to  find  the 
optimum  solution,  even  when  the  problem  size  is  small.  Approximate  methods  do 
not  carry  the  guarantee  of  an  optimal  solution,  but  rather  seek  to  find  a  '‘good”  or 
acceptable  solution  within  minimum  effort  Therefore,  this  research  rejected  the 
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implementation  of  an  optimum  solution  heuristic  search  and  chose  the  approximate 
method  for  several  reasons.  The  computational  time  and  resources  to  obtain  the 
optimal  soludon  were  deemed  unnecessary,  and  an  approximate  soludon  will  meet 
the  needs  of  the  inspection  plan,  i.e.,  the  inspection  criterion  #2  (page  52)  called  for 
an  efficient  path,  not  an  optimum  path.  The  workpieces  are  relatively  small  in  size 
and  measurements  relatively  close,  so  that  the  excess  probe  traveling  time  of  an 
approximate  solution  versus  an  exact  solution  is  inconsequential  compared  to  other 
inspection  tasks,  such  as  probe  recalibration,  setup  orientation,  and  manual  pan 
location.  For  these  reasons,  approximate  solution  methods  were  considered  as  being 
appropriate.  These  reasons  show  that  the  shonest  distance  is  not  a  top  priority. 

Why  is  it  stressed  that  an  optimum  path  is  not  critical?  Consider  the  way  in 
which  people  negotiate  their  way  across  rooms  cluttered  with  tables  and  chairs.  It  is 
unlikely  that  they  reliably  chose  the  very  best  route;  however,  they  seldom  chose  a 
very  bad  one  (Pratt.  1991].  With  the  destination  known  and  knowledge  that  several 
good  paths  exists,  the  need  for  an  optimal  path  is  not  necessary.  For  this  same  rea¬ 
son,  sensible  paths  are  appropriate  for  this  research  solution.  Another  reason  is  that 
the  most  important  factor  to  automated  robot  motion  planning  is  collision-free,  safe 
paths.  In  fact,  making  a  path  collision-free  requires  extending  the  path  around  ob¬ 
stacles  which  increases  path  length.  Once  the  collision-free  path  is  created  by  the  in¬ 
sertion  of  via-points  (section  4.3.2),  the  originally  ot  -mum  point  sequence  might  no 
longer  correspond  to  the  minimal  path.  Section  7  discusses  the  desire  for  incorporat¬ 
ing  collision-avoidance  methods  into  the  point  sequencing  ruies.  but  currently  no  one 
is  known  to  do  this. 

There  are  many  approximate  heuristic  search  algorithms  designed  to  solve  the 
TSP:  nearest  neighbor,  insertion,  asymmetrical  patching,  r-opt.  simulated  annealing. 
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tabu,  etc.  [Laporte,  1992].  The  IPEM  implemented  the  nearest  neighbor  algorithm. 
The  advantage  is  its  simplicity  and  speed  of  solution,  while  its  drawback  is  its  myopic 
view  of  the  problem.  The  path  is  constructed  by,  at  each  step,  taking  the  decision  that 
is  immediately  the  most  advantageous,  defined  by  the  minimum  distance  among  the 
cutTent  point  and  ail  the  other  remaining  points.  Once  a  point  is  placed  in  the  path, 
the  point  is  removed  from  consideration  as  a  remailing  available  point.  Appropri¬ 
ately,  another  name  for  the  nearest  neighbor  algorithm  is  the  greedy  algorithm.  The 
general  structure  for  the  algorithm  is: 

Nearest  Neighbor 

Consider  an  arbitrary  vertex  as  starting  point 
Repeat 

Determine  the  closest  vertex  to  the  last  vertex  considered  and 
include  it  in  the  tour 

Until  no  vertex  has  not  yet  been  considered 
Link  the  last  vertex  to  the  first  one 

The  time  complexity  of  this  algorithm  is  0(n2). 

Modifications  to  Nearest  Neighbor  Search 

The  generic  nearest  neighbor  algorithm  is  modified  to  make  it  meet  the  three 
inspection  plan  criteria  indicated  above.  The  first  criterion  requires  the  GD&T  rules 
of  tolerance  evaluation  to  be  met.  One  GD&T  rule  is  that  the  related  tolerances  must 
be  measured  with  respect  to  the  datums  of  the  datum  reference  frame.  Therefore, 
each  setup-DRF  structure  is  considered  its  own  individual  sequencing  sub-problem. 
This  GD&T  rule  also  implies  that  the  inspection  points  of  the  datums  that  make  the 
DRF  are  removed  from  scheduling  consideration  since  they  must  be  measured  first  in 
order  to  create  the  DRF  before  any  tolerances  can  be  measured.  A  final  implication 
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is  that  the  initial  point  of  the  nearest  neighbor  algorithm  should  not  be  chosen  ran¬ 
domly,  but  rather  should  be  selected  from  the  tertiary  datum. 

It  should  be  noted  here  that  a  CMM  evaluation  rule  also  prohibits  the  sequenc¬ 
ing  of  the  inspection  points  of  the  datums  using  the  3-2-1  DRF  creation.  The  meas¬ 
urements  of  the  primary  and  secondary  inspection  points  must  occur  in  a  specific  or¬ 
der.  regardless  of  distance.  The  direction  of  the  normal  of  the  primary,  secondary, 
and  tertiary  datums  are  calculated  by  applying  the  right-hand  rule  to  the  three  points, 
starting  with  the  first,  then  second,  then  third  measurements  or  calculations.  This 
approach  is  described  in  greater  detail  in  section  4.3.1. 

The  second  inspection  criterion  (page  52)  is  partly  met  by  this  algorithm.  An 
efficient  path  is  sought  by  means  of  the  general  nearest-neighbor  search;  however,  a 
safe  path  is  not  considered.  The  collision  avoidance  algorithm  is  discussed  in  section 
4.3.2. 

.  The  chird  inspection  criterion  might  be  the  most  overlooked  aspect  of 
automated  process  planning  systems  —  inspector  ease  of  use.  Since  the  RDS  is 
designed  to  help  humans  perform  their  job  better,  an  output  that  requires  extensive 
interpretation  by  the  inspector  for  it  to  be  understood  will  defeat  its  own  purpose  and 
worthiness.  The  two-levei  hierarchical  search  modification  to  the  nearest-neighbor 
algorithm  implements  the  thinking  process  of  the  inspector  into  the  search.  Since  the 
inspector  visualizes  the  inspection  plan  in  terms  of  evaluation  results  of  a  set  of 
measurements,  ail  required  inspection  points  within  a  tolerance  evaluation  are  meas¬ 
ured  together  at  once,  and  the  evaluation  is  performed  immediately  after  the 
measurement  of  the  last  point.  The  alternative  method  measures  the  inspection  points 
in  accordance  with  a  minimum  distance  criterion,  regardless  of  which  tolerance 
evaluation  method  the  measurement  point  was  created  for.  Once  measured,  the 
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coordinate  values  are  saved  into  memory,  and  all  the  evaluations  are  performed  at  the 
end  of  the  measurement  sequence.  This  method  results  in  a  confusing  and  unfriendly 
plan  representation  for  the  inspector. 

Using  the  two-level  hierarchical  search  provides  benefits  for  both  the  second 
and  third  inspection  criteria.  First,  the  inspector  can  see  before  and  during  the  in¬ 
spection  why  a  point  is  being  measured:  each  evaluation  occurs  directly  after  all 
inspection  points  are  measured,  and  all  inspection  points  needed  for  the  evaluation 
function  are  measured  sequentially,  and  not  intermixed.  The  learning  curve  of 
interpreting  the  automatically  generated  inspection  plan  is  significantly  reduced. 
Second,  the  evaluation  functions  by  the  CMM  language  operate  immediately  on  the 
completion  of  measurements  and  not  at  the  end  of  the  plan.  This  allows  the  ability  to 
take  advantage  of  go/no-go  evaluation  techniques.  For  example,  by  placing  the 
righdy  toleranced  or  a  priori  difficult-to- manufacture  features  to  be  completely 
measured  first,  the  inspection  process  can  promptly  quit  when  an  evaluation  fails  to 
be  within  tolerance,  thus  eliminating  unnecessary  probing.  A  future  consideration  for 
the  IPEM  is  to  utilize  statistical  process  control  (SPC)  information  to  learn  which 
tolerances  are  '‘important'’  based  on  previously  inspected  workpieces. 

tapis, msaarion 

The  heuristic  search  begins  at  the  tertiary  datum  of  the  DRF.  Since  the  3-2-1 
DRF  creation  method  is  used,  the  ternary  datum  is  just  a  single  point.  The  top-level 
search  executes,  choosing  the  nearest  neighbor  to  the  tertiary  datum  from  among  all 
the  inspection  points  in  the  DRF,  no  matter  with  which  MR  it  is  associated.  The  MR 
that  contains  this  nearest-neighbor  point  is  sequenced  as  the  first  MR  in  the  DRF. 

The  algorithm  now  begins  the  second  level  of  the  hierarchical  search.  A  nested 
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greedy  search  starts  anew  using  the  nearest-neighbor  point  from  the  top-level  search 
as  the  inidai  point  for  the  lower- level  search.  The  only  valid  inspection  points  for 
this  search  are  the  ones  contained  within  the  current  MR,  Lc.,  the  MR  chosen  from 
the  first  level  Once  the  nearest-neighbor  ordered  path  is  completed  for  the  MR's  in¬ 
spection  points,  the  lower-level  search  returns  the  last  point  of  the  ordered  point  set  to 
the  top-level  search,  where  it  replaces  the  current  point  selected  before  the  lower- 
level  search.  The  top-level  search  continues  the  nearest-neighbor  algorithm  with  the 
replaced  point  from  the  end  current  MR.  Obviously,  once  an  MR  and  its  inspection 
points  are  optimized  in  the  lower-level  they  are  no  longer  eligible  within  the  algo¬ 
rithm  for  nearest-neighbor  consideration  any  longer. 
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Figure  30.  Flow  diagram  of  the  two-level  nearest-neighbor  algorithm. 


Results 

The  results  of  the  two-level  hierarchical  nearest-neighbor  algorithm  are  shown 
to  be  acceptable.  Figure  31  is  a  snapshot  from  the  IPEM  display  window  with  a  pan¬ 
model  that  is  designed  after  an  actual  pan  received  by  the  QA  engineers  at  the  4950th 
Test  Wing.  The  tertiary  point,  denoted  with  a  '‘circled  t"  beside  it.  is  the  starting 
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point  for  the  algorithm.  The  path  is  seen  as  sensible,  and  is  actually  the  global 
minimum. 


The  path  generated  using  this  method  is  not  always  the  global  minimum.  In 
fact,  mote  often  than  not,  that  is  not  the  case.  The  pan-model  in  Figure  3 1  contained 
only  MRs  with  one  point  to  be  considered  for  sequencing.  As  the  MRs  contain  more 
inspection  points,  the  sequenced  path  will  deviate  from  the  minimum  path.  Figure  32 
shows  an  example  result  of  this  situation.  Notice  that  the  path  does  cross  over  itself 
several  times,  but  there  is  an  ordered  flow  to  it  across  the  product  that  the  inspector 
will  recognize  and  appreciate:  the  probe  travels  completely  throughout  an  MR  before 
going  to  the  next  closest  path. 
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second  MS  dnooen 


Figure  32.  Illustration  of  two- level  nearest-neighbor  algorithm  with  multiple 
inspection  points  per  MR. 


4.2.2.  Hopfieid  Net  Scheduling  with  a  Rule-Based  Lyaponov 
Function 

In  1985,  J.  J.  Hopfieid  and  D.  Tank  showed  that  artificial  neural  networks 
(ANNs)  could  be  used  to  solve  complex  combinatorial  optimization  problems  by 
solving  the  10-city  TSP  problem.  The  results  were  actually  slower  than  a  popular 
heuristic  search  [Xu  and  Tsai,  1991].  However,  the  use  of  artificial  neural  networks 
has  become  very  attractive  due  to  inexpensive  VLSI  (very- large- scale- integrated)  cir¬ 
cuit  technology  [Takefuji,  1992].  Many  researchers  have  improved  upon  the  origi¬ 
nal  Hopfieid  energy  function  to  obtain  worthwhile  results.  Abe,  et  ai.,  (1992)  says 
that  the  Hopfieid  neural  network  is  ‘‘well  suited  to  obtain  near  optimal  solutions  for 
combinatorial  optimization  problems.” 

Takeruji's  book  discusses  the  implementation  of  neural  networks  for  problem 
solving  and  has  a  stated  intention  to  '‘demonstrate  the  capability  of  the  artificial  neu- 
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ral  network  for  solving  optimization  problems  over  the  best  known  algorithms  or  the 
best  methods  if  they  exist”  One  of  the  reasons  for  such  successful  results  is  the 
modeling  of  the  energy  funcdons  and  motion  equations  that  are  used  to  drive  the 
network  to  the  solution. 

The  approach  in  this  research,  to  implement  a  neural  network  for  inspection 
point  placement  is  adapted  from  the  Hopfield  neural  network  model.  However,  the 
goal  is  the  intelligent  ordering  of  inspection  points  based  upon  the  three  basic 
inspection  criteria  (section  4.2),  not  just  a  minimum  distance.  The  approach  to  meet 
the  inspection  criteria  is  accomplished  through  rule-based  weight  matrices 
implemented  within  the  Lyaponov  energy  function  of  the  neural  network.  The 
weight  matrices,  created  within  the  IPEM,  are  based  upon  desired  inspection 
techniques  and  rules  that  the  inspector  would  use  for  inspection  point  sequencing 
throughout  the  inspection  plan.  Using  inspection  rules  within  the  motion  equation  of 
the  neural  network  will  produce  an  output  sequence  that  is  optimum  for  the  task  of 
inspection  planning. 

Neural  Network  Representation  for  Optimization 

The  implementation  of  neural  networks  involves  modeling  the  neurons  to  rep¬ 
resent  the  finite  elements  of  the  problem  and  giving  the  neurons  a  modon  equation  to 
guide  them  to  the  desired  solution.  In  optimization  scheduling,  a  neuron  represents  a 
task  i  being  performed  at  time  j.  Each  neuron  has  input  U  and  output  V.  For  a  prob¬ 
lem  with  n  tasks  with  each  task  to  be  performed  once,  the  set  of  all  possible  states  is 
represented  by  V/y  for  1  <  i  <  n,  1  <j  <  n,  in  an  n  x  n  2-D  array. 
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Figure  33.  Representation  of  neural  net  resulL 

A  blackened  ceil  represents  a  neuron  that  is  “on”  or  Vty  =  1  and  task  i  is  set  to  be 
performed  at  time  j.  An  empty  cell  represents  a  neuron  that  is  “off”  or  V/y  =  0.  The 
goal  is  to  find  a  sate  of  the  system  that  represents  a  valid  solution  of  the  problem.  A 
solution  must  satisfy  all  of  the  following  constraints: 

1.  all  tasks  must  be  performed  only  once:  Y  =  i 

k 

2.  each  time  slot  can  perform  only  one  task:  »i 

k 

3.  all  tasks  must  be  performed:  II* 

*  j 

4.  the  solution  must  minimize  a  given  cost  function 

ANNs  are  a  mathematical  represenation  of  the  neurological  functioning  of  the 
human  brain.  The  network  is  structured  as  a  massively  parallel  array  of  simple  inter¬ 
connected  processing  elements  called  neurons,  representing  the  input/output  function 
of  the  biological  neuron  of  the  brain.  The  function  of  the  neuron  is  to  take  the  inputs 
of  several  independent  signals  and  produce  an  output.  The  input  signals  are 
generated  from  the  outputs  of  the  other  neurons  and  propagated  by  synaptic  links. 
The  neurons  are  given  an  input/output  function  V  =  f (U)  that  models  the  function 


biological  neurons  are  known  to  possess.  Figure  34  displays  different 
implementations  and  approximations  to  the  neuron  activation  function. 


/(£0 


1  ifU>0 
-  0ifU<0 

unchanged  otherwise 


neuron 


Hysteresis  McCuiloch-Pitts 


/((/)* 


1  ifU>UTP  (upper  trip  point) 
0  if  U  <  LTP  (lower  tnp  point) 


(unchanged  otherwise 


Figure  34.  Neuron  representation  and  input/output  functions. 


The  goal  of  the  ANN  is  to  solve  the  optimization  problem  by  providing  a  paral¬ 
lel  gradient  descent  method  to  minimize  the  system  energy.  The  system  energy  is  a 
function  of  the  neuron  outputs,  E(Vj,  V?. ...  V,),  defined  by  the  programmer  to  best 
solve  the  optimization  problem.  The  change  in  the  value  of  the  input  state  of  the  z^1 
neuron  is  determined  by  the  partial  derivatives  of  the  energy  function  with  respect  to 
its  output 

_  mv\.yz . v„)  (45) 

d /  3Kf 

This  is  called  the  motion  equation  of  the  neuron,  since  it  defines  how  the  energy 
will  propagate  through  the  network  —  towards  minimizing  the  computational  energy. 
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Takefuji  (1992)  states  that  it  is  usually  easier  to  build  the  motion  equation  and  then 
derive  the  energy  equation  from  the  integration  of  equation  (4.5): 

E  *  {dE  =  -\^dV,  (4.6) 

*  at 

In  their  original  paper,  Hopfield  and  Tank  (1985)  defined  the  neuron  modon  equation 
as: 


d  Uj  t  U,  3 E 

dt  *  x 


j*>  x*r  \x  j 

~£>^dXY  +yYj- 1) 


(4.7) 


The  use  of  the  decay  term  (-£/,-/ t)  is  now  known  to  hurt  the  dynamics  of  the  aetwark 
[Takefuji,  1992].  Removing  the  decay  term  produced  more  efficient  modon  equa¬ 
tions  and  enhanced  the  performance  of  the  ANN  to  solve  optimization  problems. 
Equadon  (4.8)  shows  a  modon  equadon  which  is  a  slight  update  from  the  original 
Hopfield  model  in  equadon  (4.7),  and  is  generally  accepted  as  the  standard  modon 
equadon  for  Hopfield  network  implementation  for  solving  the  TSP  opdmizadon 
problem  [Xu,  i991](Jeon,  l990][Abe,  et  al„  1992]. 
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The  A  summadon  term  monitors  the  first  and  second  constraints  stating  that 
each  row  and  column  should  have  only  one  neuron  fired,  i.e.,  “on”.  The  two  C 
summadon  terms  are  Takefuji’s  (1992)  hill  climbing  term  implemented  to  help  the 


68 


network  oration  to  escape  local  minima.  The  final  D  summation  term  provides  the 
criterion  to  be  minimized.  represents  the  Euclidean  distance  in  the  TSP  problem, 
or  can  be  defined  to  represent  any  cost  function  modeling  the  problem  to  be 
minimized. 

The  neuron  energies  are  then  updated  by  the  first  order  Euler  method: 

d  UiAt) 

£ty(/+0-Cfy<0+— - — to  (4.9) 

where  Ar  =  1,  representing  one  time  step.  The  process  of  running  the  network  is  a 
simple  loop  terminated  by  a  system  state  check: 


Am 

Initialize  each  neuron  input  with  a  random  number 
Repeat 

Evaluate  the  output  of  the  neuron  based  on  the  neuron 
input/output  function  V  =  f (£/) 

Update  the  inputs  to  each  neuron  from  the  motion  equation, 
equation  (4.8)  and  equation  (4.9) 

Until  there  is  no  more  than  one  neuron  on  in  any  row  or  column 
or  the  number  of  iterations  is  greater  than  the  maximum  allowed 


Uawpy  Funcnwg 

The  puxpose  of  a  Lyaponov  function  is  to  provide  a  shortcut  to  proving  global 
stability  of  a  dynamic  system  (Kosko,  1992].  In  general,  the  Lyaponov  approach  re¬ 
veals  only  the  existence  of  stable  points,  not  their  number  or  nature. 

A  Lyaponov  function  L  maps  system  state  variables  into  real  numbers.  A  sys¬ 
tem  is  called  stable  if  L  decreases  along  its  trajectories  with  respect  to  time.  This  is 
proved  by  showing  that  the  change  in  L  with  respect  to  the  change  in  time  is  negative 
for  ail  time: 
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{AUAi)  <  0;  for  stable  system  L, 

(ALJAi)  <  0,  for  asymptotically  stable  system  L.  (4. 10) 

Used  mosdy  in  control  systems,  the  Lyaponov  function  has  been  applied  to 
neural  network  analysis  to  provide  insight  into  the  stability  of  the  network’s  energy 
state.  Consider  the  time  derivatives  of  the  neural  network  energy  function: 

dE  _  r-  _  y  dVj  3£ 

dt~  “  2*  dt  3  Vi 

i 

ZdVj  dUj 

ITT  (4.11) 

j 

_  ^  Y  (  dv,  dUAdUj  =  y  fdUA2  dl'j 
dU,  dt  J  dt  dt  )  dUj 

i  i 

The  first  line  uses  the  chain  rule  to  get  the  time  derivative  of  £(V /,  Vj, ...  Vn).  The 
second  line  is  obtained  from  the  substitution  of  equation  (4.5)  into  the  first  line.  The 
third  line  is  a  chain  rule  expansion  of  the  ( <N[idx )  term  and  then  simplification.  Since 
0 dUiidtf  will  always  be  positive  (due  to  the  squaring),  the  negation  of  the  sum  of 
squares  will  always  be  negative.  Therefore  the  partial  derivative  of  the  neuron 
input/output  function  ( (N [I dU[ )  must  be  negative  for  equation  (4.10)  to  be  valid.  The 
McCulloch-Pitts  function  (Figure  34  on  page  66),  chosen  as  the  neuron  input/output 
function  for  this  research,  has  us  change  in  output  with  respect  to  the  change  in  input 
that  is  always  less  than  zero  (a  negative  slope).  Therefore,  the  energy  derivative 
C dE/dt )  is  less  than  zero  and  the  neural  net  is  stable. 

Implementation 

Two  main  accomplishments  provided  the  implementation  of  the  rule-based 
Lyaponov  function  within  a  Hopfield  neural  network  for  optimization.  The  first  ac- 
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complishment  created  a  set  of  rules  that  portrayed  the  desires  of  the  inspector  m  the 
inspection  plan  creation.  The  rules  ate  written  in  the  IPEM  and  are  based  on  relation¬ 
ships  held  between  the  inspection  points  and  their  MRs  and  surfaces.  Three  different 
types  of  matrices  were  created  from  the  inspection  rules  to  be  used  by  the  ANN. 

The  second  accomplishment  implemented  an  ANN  that  would  optimize  the 
measurement  point  sequence  based  on  the  inspection  rule  matrices  created  within  the 
IPEM.  The  software  implementation  of  the  ANN  began  with  the  work  done  by  Jeon 
(1990),  which  was  designed  for  the  purpose  of  inspection  planning  techniques,  but 
only  addressed  the  issue  of  minimum  distance  and  not  inspection  criteria.  His  setup 
is  identical  to  the  two-level  nearest- neighbor  heurisdc  search  discussed  in  section 
4.2.1,  except  that  neural  network  optimization  replaced  the  lower-level  greedy  search. 
His  network  optimization  was  limited  to  singular  surfaces  as  well  as  singular  features. 
Therefore,  several  modifications  to  Jeon's  neural  network  were  made  to  allow  the 
implementation  of  the  inspection  rules.  The  neuron  motion  equation  and  update 
functions  were  changed  to  accept  the  three  inspection-rule-created  matrices  from  the 
IPEM. 


ImBlsmsaanfliL  Creating?  tp  to.  inJJSE 

Two  different  forms  of  rules  were  realized  to  represent  a  preference  in  inspec¬ 
tion  point  sequencing.  The  first  form  relates  a  point  to  its  overall  sequence  position 
in  the  inspection  plan.  For  example,  one  inspection  rule  states  that  all  “tight” 
tolerances  must  occur  at  the  beginning  of  the  sequence  of  measurements.  The 
definition  of  “tight”  is  defined  by  the  inspector,  but  the  IPEM  currently  uses  a  value 
of  0.005  inches.  An  S  matrix  (mnemonic  for  Sequence)  represents  this  form  of  rale 
by  telling  the  neural  net  whether  a  point  i  at  sequence  j  is  allowed  to  exist  according 
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the  inspection  rules.  S,y  =  1  if  the  sequence  position  is  allowed,  and  5(y  =  0  if  it  is 
forbidden.  This  S-rule  is  implemented  by  counting  the  total  number  of  tight 
tolerances  and  setting  Sty  =  1  for  each  tight  tolerance  i  and  1  <j  <  (total  number  of 
tight  tolerances);  otherwise,  S,y  =  0.  For  each  non-dght  tolerance  i,  5,y  =  1  for  (total 
number  of  tight  tolerances)  <j  <  n;  otherwise,  S,y  =  0. 

One  other  5-rule  also  exists.  It  states  that  the  tertiary  tolerance  must  be  the  first 
sequence  point,  and  that  no  other  point  is  allowed  to  be  first  This  requirement  is 
easily  implemented  by  setting  Sqq  =  l  and  Sgi  =  S(Q  =  0  for  1  <  i  <  rt.  Notice  that  the 
matrix  indicators  are  zero- based,  to  represent  their  implementation  in  both  LISP  and 
C  software  languages. 

5  matrix  created  by  two  S-ruies:  tertiary  and  tight 

total  number  of  tight  tolerances  (3) 
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Figure  35.  Populating  the  5  manix. 


The  second  form  of  inspection  rule  relates  one  inspection  point  to  another. 
Two  matrices  fulfill  this  type  of  rule.  The  W  matrix  (mnemonic  for  Weight)  is  the 
standard  distance  matrix  seen  in  TSP  problems.  Wy  represents  the  Euclidean  dis¬ 
tance  from  point  i  to  point  j.  The  F  matrix  (mnemonic  for  Follow)  represents  the 
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rule-based  penalty  value  for  point  t  being  followed  by  point  y  at  any  two  sequential 
time  slots  in  the  inspection  plan.  For  example,  one  f-rule  states  that  if  two  points,  i 
and  y,  are  from  the  same  MR,  then  F[j  should  be  some  negative  value  (good),  other¬ 
wise  F[j  should  be  some  positive  value  (bad).  The  inspection  rules  currently  imple¬ 
mented  create  a  cumulative  penalty  value  for  F[j  based  on  both  good  and  bad 
reinforcements: 

bad  (+)  i  and  y  are  from  different  MRs 
bad  (+)  l  and  j  are  on  different  surfaces 
bad  (+)  i  and  j  are  different  types  of  features 
bad  (+)  i  and  j  are  different  types  of  tolerances 
good  (-)  i  and  y  are  the  same  feature  type 
good  (-)  i  and  j  are  the  same  feature  type  and  have  the  same 
feature  dimensions 

good  (-)  i  has  a  tighter  tolerance  than  y 
bad  (-!-)  y  has  a  dght  or  critical  tolerance  and  i  does  not 
good  (-)  both  i  and  y  have  tight  tolerances 

The  inspector  can  vary  the  relative  strength  of  the  individual  inspection  rules  to 
customize  the  rules  to  produce  the  desired  output  The  rule  strength  parameters  allow 
some  rules  to  be  weighted  more  heavily  than  others  by  changing  individual  weights 
that  pre-mul tiply  each  rule  before  it  is  summed  into  F[j.  A  future  user  interface  will 
give  the  inspector  easy  access  to  the  rules  allowing  him  to  manipulate  the  outcome  of 
the  schedule  solution  as  desired. 

Notice  that  some  inspection  rules  can  be  implemented  in  both  the  5  and  F 
matrices.  This  is  advantageous  to  the  ANN.  By  telling  the  ANN  similar  rule 
information  in  different  formats,  the  search  criteria  becomes  more  robust  resulting  in 
a  quicker  convergence. 
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Figure  36-  The  S,  W,  and  F  matrices  used  to  implement  inspection  rules  into 
the  neural  network. 


Below  is  an  example  of  a  rule  implementation  as  executed  from  within  the  IPEM. 

;;  tight  tolerance  —  f  represents  F[i][j] 

(cond  ((and  <<-  (tol-valueS  pti)  tight-tol) 

(<»  (tol-value@  ptj)  tight-tol))  ;i&j  tight 
(setf  f  (+  f  (*  Wtight  good)))) 

( (and  (>-  (tol-valueg  pti)  tight-tol) 

(<-  (tol-value6  ptj)  tight-tol))  ;j  tight,  i  not 
(setf  f  (+  f  (*  Wtight  bad)))) 

( (and  (<-  (tol-value6  pti)  tight-tol) 

(>»  <tol-value€  ptj)  tight-tol))  ;i  tight,  j  not 
(setf  f  (+  f  (*  Wtight  good)))) 

(t  (setf  f  (+  f  (*  Wtight  ok)))))  .-otherwise 

Notice  that  the  rules  contain  both  good  and  bad  reinforcements.  Since  the  IF,y  will 

be  utilized  in  the  fashion  of  a  distance  penalty  which  is  minimized  by  the  ANN, 

good  s  -1,  bad  s  1,  and  ok  s  0. 
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Once  the  matrices  have  been  created,  they  are  post-processed  for  use  by  the 
ANN.  Each  matrix  is  normalized  so  that  every  value  in  the  array  is  between  zero  and 
one.  The  W  matrix  also  has  minimum  shift  performed  on  each  of  its  rows.  For  each 
measurement  point  (row)  in  W,  the  smallest  distance  to  each  of  the  other  points 
(columns)  is  determined  and  subtracted  from  each  of  the  points  in  that  row.  This 
leaves  the  relationship  between  the  points  constant,  but  the  minimum  distance  is  now 
0.00.  This  speeds  up  the  convergence  of  the  ANN. 


Implementation:  Utilizing  inspection  rules  in  the  ANN 

Several  modifications  to  the  ANN  model  described  above  were  performed  to 
incorporate  inspection  rules  into  the  solution  selection.  The  first  modification  re¬ 
quires  that  the  tertiary  tolerance  always  be  sequenced  first  and  at  no  other  sequence 
position,  and  that  no  other  tolerance  occupy  the  first  sequence  position.  These 
requirements  are  accomplished  by  setting  vqq=1  and  vzy  *  0  for  i  -  0,  j  *  0  and  j  »  0, 
i  *  0  within  the  neuron  input/output  evaluate  function.  This  approach  is  implemented 
in  addition  to  the  S-rule  mentioned  above  to  provide  faster  convergence. 

In  order  to  shorten  the  convergence  time,  the  energy  input  values  are  kept 
within  fixed  limits.  Therefore,  when  Uyft+I)  is  calculated  and  r  updated,  the  value 
of  Uijit )  is  evaluated  by: 


HL  if  Ujj  >  HL  (high  limit) 
LL  if  Ujj  <  LL  (low  limit) 
unchanged  otherwise 


(4.12) 


This  approach  provided  a  significant  improvement  in  the  run-dme  of  the  ANN. 
When  these  thresholds  were  used,  the  number  of  iterations  required  to  reach  a 
solution  decreased  by  two  orders  of  magnitude! 


75 


The  actual  neuron  motion  equation  (4. 13)  was  aiso  modified  to  accommodate 
the  new  inspection  rule  information.  The  W  matrix  remains  the  distance  penalty  from 
before.  The  F  and  S  matrices  are  also  treated  in  the  same  manner  as  distance  penalty 
functions.  The  5{y  value  is  arlfWi  to  the  update  equation  rather  than  subtracted,  since 
it  was  defined  as  a  positive  value  for  preferable  and  zero  for  not  preferable. 
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The  A  summation  term  monitors  the  same  row  and  column  constraints  as  discussed  in 
equation  (4.8)  on  page  67.  The  B  summation  term  is  the  standard  Euclidean  distance 
term  from  Hopfield  ( 1985)  and  is  equivalent  to  the  D  summation  term  of  equation 
(4.8).  The  W'  is  the  distance  matrix  prior  to  the  minimum  shift  operated  on  each  row. 
The  C  summation  term  prevents  the  system  from  taking  roundabout  paths,  and  is 
discussed  in  greater  detail  by  Jeon's  thesis  (1990).  The  D  summation  term  represents 
the  hill-climbing  function  thai  helps  the  system  escape  local  minima.  It  is  equivalent 
to  the  C  summation  term  of  equation  (4.8).  The  FI  summation  term  represents  the 
penalties  from  the  F-rules  according  to  the  current  system  status  of  Vy  with  respect  to 
the  points  scheduled  before  and  after  it.  As  mentioned  above,  the  5ty  term  is  simply 
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added  into  the  neuron  update  equation  to  represent  the  inspection  rule  of  point  i  oc¬ 
curring  at  sequence  order  j. 

One  inspection  rule  was  implemented  within  the  ANN  to  update  the  FI  coeffi¬ 
cient  according  to  the  state  of  the  system.  The  F/y' s  are  created  based  on  the  F -rules 
which  state  that  a  point  with  a  certain  characteristic,  cj,  should  not  follow  a  point 
with  a  different  characteristic,  c?-  However,  at  some  moment  in  the  inspection  plan, 
the  sequence  of  inspection  points  will  have  sequenced  all  the  points  with  characteris¬ 
tic  ci  and  will  then  switch  to  points  with  characteristic  cj.  This  switch  over  is  pref¬ 
erable  and  should  not  be  penalized.  Therefore,  the  FI  coefficient  is  updated  by  an  in¬ 
spection  rule  within  the  ANN  which  sets  FI  equal  to  zero  if  the  F-rule  penalty  is  not 
desired  because  all  other  F-ruies  are  satisfied. 

Results 

A  comparison  is  made  between  the  two  sequencing  optimization  techniques 
discussed  in  this  section.  Figure  31  on  page  62  shows  the  result  of  a  two-level 
nearest-neighbor  search  algorithm  on  a  part-model  created  within  the  RDS  and 
processed  within  the  IPEM.  The  same  part  is  shown  in  Figure  37  to  illustrate  the 
greater  power  of  the  rule-based  ANN.  The  four  larger  through-holes  near  the  edges 
of  the  part-model  have  dght  position  tolerances  with  a  tolerance  value  of  0.0005 
inches.  Using  the  5  and  F  matrices,  the  ANN  places  these  four  holes  at  the  beginning 
of  the  inspection  plan,  then  sequences  the  remaining  tolerances.  While  meeting  the 
inspection  rules,  the  ANN  also  provides  the  minimum  distance  path. 


Figure  37.  Illustration  of  rule-based  ANN  sequence  result. 


The  ANN  reached  the  solution  in  177  iterations,  which  is  almost  no  rime  on  a 
SPARC2  workstation!  The  speed,  accuracy,  and  thoroughness  of  the  rule-based 
ANN  make  it  a  superior  solution  method  for  scheduling  oprinrizarion.  The  output 
path  represents  a  sequence  readable  to  the  inspector,  since  they  are  created  by  the 
same  rules  that  the  inspector  would  use. 

4.3.  Automated  CMM  Code  Generation 

The  £PEM  is  intended  to  be  a  complete  automated  inspection  system.  Every  as¬ 
pect  of  the  inspection  plan  creation  and  execution  is  intended  to  be  aided  to  enable 
the  engineer  to  do  the  same  quality  job  faster.  One  particularly  tedious  job  for  any 
QA  engineer  is  programming  the  CMM  for  automated  inspection.  Due  to  the  rather 
recent  introduction  of  computer-controlled  CMMs,  there  has  not  been  a  standard 
language  until  very  recently.  As  a  result,  each  CMM  manufacturing  company  has 
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been  designing  its  own  software  language  to  interface  its  hardware  interpreter.  Since 
the  strengths  of  this  type  company  are  usually  in  the  hardware  rather  than  software, 
the  language  is  usually  low-levei  and  cryptic.  Two  unpleasant  situations  result.  First, 
the  commands  are  hard  to  remember  because  they  are  usually  mnemonic,  and  they 
are  especially  hard  to  use  since  such  low-level  languages  have  little  or  no  branching, 
looping,  or  variable  capabilities.  Second,  since  the  language  is  controlling  an 
expensive  sensing  device,  an  error  is  extremely  critical.  One  typographical  error, 
added  digit,  or  overlooked  minus  sign  can  send  the  probe  crashing  into  the  work- 
piece,  table  top,  fixturing,  or  itself.  The  cryptic  commands,  low-level  programming, 
and  point  values  that  must  be  accurate  to  thousandths  of  an  inch  exacerbare  the 
potential  human  error  factor. 

The  automated  code  generator  produces  the  desired  output  of  the  EPEM  —  ex¬ 
ecutable  CMM  instructions  to  an  ASCII  text  file  that,  when  downloaded  ©  the  CMM 
controller,  will  perform  the  automated,  efficient,  and  safe  (no  collisions)  inspection 
plan  to  determine  if  the  pan  is  within  tolerance.  The  processes  involved  in  amomaied 
code  generation  are  path  planning  for  an  efficient  and  coilision-ffee  probe  path 
(4.3.2),  feature  translation  from  the  process  planner  into  a  metacode  representation 
(section  4.3.4),  and  code  generation  from  the  mctacode  features  (section  4.3.5). 

4.3.1.  The  CMES  Language 

The  CMM  used  in  QA  procedures  of  the  4950th  Test  Wing  is  made  by  LK 
Tool  USA,  Inc.  and  uses  a  proprietary  language  called  CMES  (Co-ordinate 
Measuring  Software).  The  CMES  manual  describes  the  language  in  not  so  user- 
friendly  terms: 
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CMES  responds  to  mnemonic  commands  known  as  command  codes. 
[T]hese  codes  comprise  rwo  characters  which  usually  describe  the 
function  of  the  command.  [F]or  example,  ID  and  PT  represent  the 
Inside  Diameter  and  Point  commands,  respectively.  In  order  to  in¬ 
crease  the  capability  of  each  command,  most  CMES  commands  are 
equipped  with  command  parameters  which  are  used  to  cause  the  com¬ 
mand  to  funcdon  in  a  specific  manner. 

An  example  of  a  block  of  CMES  code  to  inspect  just  one  hole  and  one  slot,  with  the 

datums  already  created: 

#MC,X, Y\10.5\-52.46 
#MC, Z\-2 

#PP, Y\-58.5\SP, 10\#PP,Y\-48.75\SP, 11 
#MC, Z\10 

UP,10,11\LI,Y//\10.25,  .005, -.002 
#MC, X,Y\12.S\-35.00 
#MC, Z\-1.5 

#ID, ZM\3 . 45 ,  .001, - .015\ .200 
#MC,  ZU0.00 

Appendix  B  contains  a  quick  reference  to  CMES  code.  It  is  placed  there  for 
three  reasons.  First,  there  are  examples  of  CMES  code  throughout  this  paper  that  the 
reader  may  want  to  try  and  decipher.  Second,  it  will  help  the  novice  reader 
understand  the  work  of  the  inspector  and  appreciate  the  value  of  an  automated  code 
generator.  Third,  the  reader  who  knows  other  software  languages  will  be  able  to  see 
the  low-level  of  CMES,  and  will  allow  the  reader  who  knows  other  inspection  lan¬ 
guages  to  compare  between  them. 

As  mentioned  in  section  4.2.1.  there  are  also  CMES  guidelines  incorporated 
into  the  rule-based  ANN.  The  creadon  of  the  datums  is  done  by  the  CMES  com¬ 
mands  AX,  Nl,  N2,  PI,  and  MD.  These  commands  use  the  order  in  which  the 
measurements  are  taken  to  determine  the  direction  of  the  normal  of  the  surface 
created  with  these  commands.  Starting  at  the  first  measured  point  and  rotating 
through  to  the  third  measured  point.  AX  uses  the  right-hand  rule  to  define  the 


80 


positive  direction  of  the  normal  of  the  plane  defined  by  the  three  points.  The  N1 
command  defines  the  positive  direction  of  the  secondary  axis  using  the  right-hand 
rule  on  the  two  measured  points  and  a  third  point  calculated  along  the  normal  of  the 
primary  axis  (from  AX)  using  the  two  measured  points  as  the  base.  The  N2  axis 
positive  direction  is  constrained  by: 

i  ®  y  =  f 

,y®i  =  r  (4.14) 

f  ®i  =  _y 

Since  the  inspection  point  measurements  are  created  with  a  pre -defined  coordinate 
axis  system,  the  order  of  the  datum  plane  measurement  points  must  not  change  during 
inspection  point  scheduling  optimization. 


secondary  da turn  normal 
(N1)  direction  from  two  y 
measurements  and  one  ± 
calculated  pone 


third  point  of  Ml 
( secondary  datum) 
calculated  in  direction  of 
primary  normal 


tertiary  point 
on  “left"  surface 


origin  defined  by 
intersection  of  three 
datum  planes  (P1/M0) 


z  primary  datum  normal 
(AX)  direction  from 
nght-hand  rule  of  three 
measured  points 


tertiary  datum 
normal  (N2) 
constrained  to 
axss  product  of 

z&y 


Figure  38.  DRF  creation  within  the  CMES  language. 


4.3.2.  Collision- free  Path  Planning 

Because  of  the  expense  of  automated  robot  equipment,  an  obviously  crucial 
task  in  any  robot  motion  planning  is  collision  avoidance.  It  is  a  difficult  task  for  the 
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inspector  to  perform  manually.  It  involves  the  creation  of  the  intermediate  points, 
called  via  points,  relative  to  the  obstacles  that  the  probe  trajectory  must 
circumnavigate,  which  is  usually  obvious  to  the  inspector.  Via  points  break  the 
intersecting  path  into  sub-paths  which  divert  the  colliding  path  around  the  obstacle. 
Then  coordinate  values  of  the  via  points  relative  to  the  setup  orientation  and  DRF 
origin  must  be  calculated,  which  is  very  difficult  for  the  inspector  due  to  the 
trigonometry,  rotation,  and  translation  that  is  required.  However,  the  point 
coordinate  calculation  is  trivial  for  the  computer,  but  the  point  creation  or  point 
placement  is  difficult  Several  obstacle  avoidance  algorithms  have  been  proposed 
that  deal  with  safe  and  efficient  robot  path  planning.  The  algorithms  can  be  grouped 
into  the  following  classes: 

1.  hypothesize  and  test  [Gewali,  et  aL.  1990]  [Pratt  1991]  [Bonner 
and  Kelley,  1990] 

2.  penalty  function  [Brady,  1982] 

3.  explicit  ffee-space  [Sharir.  1986]  [Lozano-Perez,  1979  &  1987] 
The  hypothesize  and  test  method  is  the  earliest  proposal  for  robot  obstacle 

avoidance.  Its  technique  is  to  create  a  path  candidate  between  the  initial  and  final 
points,  and  to  test  for  possible  collisions.  If  a  collision  would  occur,  then  a  hypothe¬ 
sis  creadon  method  is  proposed  to  create  a  new  path  candidate  to  test.  This 
“hypothesize  and  test”  step  is  repeated  until  a  safe  path  is  found,  or  the  method  times 
out. 

The  penalty  function  defines  a  numerical  value  for  all  possible  probe  positions 
within  its  workspace.  The  function  returns  an  infinite  penalty  for  positions  that 
would  cause  collisions,  then  sharply  drops  off  as  the  distance  from  the  pan  increases. 


ft 
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source:  (Brady, «  aL,  19821 

Figure  39.  Penalty  function  to  create  a  collision-free  path. 


The  explicit  free-space  method  builds  explicit  mathematical  representations  of 
subsets  of  robot  configurations  that  are  free  of  collisions. 

The  penalty  function  is  attractive  for  combining  the  constraints  from  multiple 
objects;  however,  our  problem  consists  of  planning  a  path  for  one  3-D  solid  object. 
The  free-space  method  works  well  in  2-D,  but  has  been  found  to  be  computationally 
very  expensive  in  3-D  [Bonner  and  Kelley,  1990].  The  EPEM  adapted  the  approach 
of  the  hypothesize  and  test  method  to  discover  a  collision-free  path.  It  was  chosen 
for  its  simplicity  (of  both  implementation  and  representation)  and  yet  satisfactory 
solution  for  the  problem  encountered.  However,  an  improved  quality  of  solution  and 
reduced  computational  time  are  developed  by  a  number  of  facts  and  constraints  that 
define  tins  research  project: 

1.  there  exists  just  one  obstacle  (defining  the  CMM  table  as  a  constraint),  the 
pnsmanc  solid  pan  model,  in  which  to  avoid  probe  collision; 

2.  there  exists  a  calculable  and  reachable  safe  plane  above  and  on  all  sides  of 
the  part  within  which  the  probe  may  always  travel  freeiy; 

3.  based  on  the  inspection  plan  sequencing  algorithm,  all  inspection  points  are 
accessible  by  the  probe  from  the  offset  safe  piane  above  the  part;  and 

4.  creating  a  DRF  consists  of  measuring  three  mutually  perpendicular  sur¬ 
faces. 
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Four  different  hypothesis  test  methods  were  implemented  to  utilize  these  facts. 
The  first  two  methods  do  not  actually  perform  a  search  through  a  defined  space,  but 
rather  query  the  solid  modeler  about  the  geometric  relationship  between  the  initial 
surface  and  the  goal  surface.  The  third  method  does  perform  a  search;  however,  it 
entails  a  reduced  complexity  by  allowing  the  assertion  that  a  collision-free  path  is 
always  not  more  than  two,  or  at  the  most  three,  sub-path  combinations.  Therefore, 
the  search  has  a  maximum  limit  of  three  sub-paths  (two  via  points)  to  its  search  space 
from  which  it  will  return  a  failure.  The  fourth  method  not  only  creates  a  collision- 
free  path  without  performing  a  search,  but  also  does  not  query  the  solid  modeler. 


amez.  safe  nfanas 


Figure  40.  Safe  planes  are  offset  from  the  bounding  box  of  the  pan-model. 


The  third  and  fourth  methods  of  creating  a  hypothesis  are  adapted  from  the 

research  of  Gewali,  et  ai.,  (1990)  in  path  planning  and  3-D  vertical  obstacles.  Their 

research  observes  two  propositions: 

Lemma  1;  The  shonest  path  (from  point  s  to  r]  in  a  story  problem 
either  a)  lies  completely  in  the  base  plane,  or  b)  consists  of  three  sub¬ 
paths  of  which  the  first  of  them  rises  from  s  to  some  point  Xj  on  a  hori¬ 
zontal  obstacle  edge  at  some  level  Lj,  0<i<k,  the  second  is  a  stra  ght 
line  segment  connecting  .x,-  to  y{  on  level  L,-,  and  the  third  goes  down 
from  y,-  to  t. 

Lemma  2:  A  shonest  path  from  a  point  in  the  base  plane  5  to  a  point 
in  level  £,•  consists  of  straight  line  segments  that  form  equal  angles 
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with  their  projections  on  horizontal  planes  through  their  origin  (i.e., 
these  segments  all  slope  upward  at  the  same  rate). 

Since  for  any  path  over  L^,  the  offset  safe  plane  can  be  projected  onto  L^,  no  path 

will  rise  above  it.  In  addition,  a  shortest  path  cannot  rise  above  the  base  plane  B  and 

return  to  it  unless  it  has  traveled  over  an  obstacle.  Otherwise,  the  projection  of  the 

path  onto  B  is  guaranteed  to  be  shorter  and  collision-free  since  the  problem  is 

constrained  to  a  vertical  polyhedron  and  has  smaller  and  contained  horizontal  cross 

sections  at  higher  levels,  i.e.,  no  tunnels  or  channels.  It  also  follows  that  a  falling 

section  followed  by  a  rising  section  can  be  projected  onto  the  higher  level  and  remain 

shorter  and  collision-free. 


Figure  41.  A  maximum  of  three  sub-paths  needed  to  connect  initial  and  goal  points. 

These  same  constraints  are  valid  for  the  problems  addressed  in  this  research 
(section  2.2).  The  five  degree  of  freedom  (dof)  probe  is  a  goal  of  future  work,  but 
currently  the  three  dof  probe  is  considered.  It  was  noticed  from  studying  many 
examples  of  manually  created  CMM  code  from  the  QA  engineers  at  the  4950th  Test 
Wing,  that  the  extra  degrees  of  freedom  above  the  standard  three  of  the  Cartesian 
robot  motion  were  rarely  used.  Therefore,  the  inspection  plan  has  no  setups 
containing  inspection  points  in  tunnels  or  channels. 
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Testing  the  Hypothesis 

Testing  the  hypothesized  path  for  collision  required  a  unique  implementation 
approach  due  to  the  limitations  of  the  solid  modeler.  Shapes™  from  XOX  Carp. 
There  are  several  solid  (3-D)  geometry  Boolean  commands  (intersection,  union,  and 
difference)  furnished  by  the  solid  modeler.  The  supplied  intersection  function  speci¬ 
fies  two  solid  geometry  representations  (geoms)  as  inputs  and  returns  the  new  geome¬ 
try  resulting  from  the  Boolean  intersection  operation.  The  computation  time  is  large; 
however,  more  importantly,  it  is  also  unnecessary.  The  only  answer  needed  to  test 
the  path  hypothesis  is  “yes”  or  “no”  —  the  fact  of  intersection  —  not  the  actual 
geometry  resulting  from  the  Boolean  intersection!  Determining  the  actual  geometry 
becomes  even  more  unreasonable  due  to  the  fact  that  one  of  the  input  geometries  is 
the  entire  solid  pan  model  which  is  a  complex,  three  -dimensional,  feature-based 
object  whose  entire  space  would  have  to  be  searched. 

The  solution  is  a  function  that  would  return  a  value  of  “true”  at  the  first  finite 
element  of  detected  intersection  between  the  input  geometries  without  testing  any 
further  to  complete  the  resulting  geometry.  The  function  intersection-p  was 
claimed  by  the  solid  modeler  software  manual  to  operate  in  this  manner;  however,  it 
was  discovered  that  it  was  actually  just  built  upon  the  Boolean  intersection  function 
which  calculates  the  entire  intersection  geometry  structure,  and  just  returns  a  “true” 
rather  than  the  actual  geometry. 

The  solution  of  this  research  was  to  implement  a  function  to  efficieraty  return  a 
value  of  “true”  if  the  proposed  probe  path  intersects  with  the  pan  model.  The  ap¬ 
proach  dissected  the  pan-model  into  all  of  its  2-D  surfaces.  Then  each  surface  was 
tested  for  intersection  with  the  hypothesized  path.  If  an  intersection  with  a  surface 
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would  occur,  the  function  stopped  immediately  and  returned  “true.’'  This  approach 
produced  much  faster  results  (on  the  order  of  three  times,  depending  on  when  the  in¬ 
tersection  was  found)  since  die  intersection  function  only  has  to  create  an  Boolean  in 
tersecdon  geometry  between  the  proposed  path  and  a  much  smaller,  less  complex, 
two-dimensional  surface  geometry.  The  pseudocode  of  the  function,  called  check- 
for- intersection,  is  as  follows: 


chcck-for-interscction; 

set  x  to  all  2-D  surfaces  of  the  pan-model 
for  each  line  y  in  each  sub-path  in  the  proposed  path  do 
for  each  surface  r  in  x  do 

set  r  to  result  of  the  Boolean  intersection  of  z  and  y 
if  r  is  true,  then 

quit  from  function  and  return  true  (intersection) 
return  false  (no  intersection) 


Crcadne  the  Hypothesis 

The  implementation  task  of  collision-free  hypothesis  fanning  can  be  defined  as 
via  point  ere  anon.  The  obstacles  here  are  not  polyhedron  enddes  as  used  in  [Gewali, 
et  al,  1990],  but  are  surfaces  of  the  pan-model.  Movement  around  the  surfaces  is 
defined  as  passing  around  an  edge;  therefore,  the  via  points  are  created  from  surface 
edges. 

This  research  implemented  four  search  methods  to  create  the  via  points.  These 
methods  are  called  in  a  particular  sequence  by  the  collision  avoidance  algorithm.  The 
sequence  of  methods  starts  with  the  simplest  one.  If  the  simplest  method  cannot  find 
a  path  in  its  search  criteria,  the  next  method  in  the  sequence  is  executed.  Each  subse¬ 
quent  method  takes  longer  computadonally  than  the  previous  method  or  its  path  is 
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less  efficient.  The  final  method  is  the  “catch-all”  method  which  is  guaranteed  to  find 
a  collision-free  path,  but  does  not  take  distance  into  consideration. 

The  hypothesis  creation  methods  are  named:  neighbor,  two-doors -down,  2- 
levei- geometry,  and  up-and-over,  which  is  also  the  sequence  in  which  they  are  called. 
The  collision-free  path  algorithm  inquires  each  hypothesize  and  test  method  to  create 
the  collision-free  path.  If  the  proper  information  is  not  available  or  the  method  re¬ 
turns  “false”  (no  path  was  found),  the  collision  avoidance  algorithm  calls  forth  the 
next  method  in  the  sequence. 


sjcn  ^  &  i*  w  i  1 


The  first  method  invoked  is  the  neighbor  search,  and  it  is  executed  if  both  the 
initial  and  goal  surfaces  are  known.  It  hypothesizes  a  collision-free  path  by  searching 
for  a  common  edge  between  the  two  surfaces  signifying  that  they  are  neighbors.  The 


surface  which  contains  the  initial  inspection  point  is  named  from-surface ,  while  the 
surface  which  contains  the  goal  inspection  point  is  named  10- surface.  If  there  exists  a 
common  edge  between  from-surface  and  to-surface,  the  via  point  is  created  as  an  off¬ 
set  point  from  that  common  edge.  The  path  connecting  the  initial  point  to  the  via 
point,  and  the  via  point  to  the  goal  point  is  tested  to  determine  if  it  is  collision-free 
using  the  check- for- inter  sect  ion  function  described  above.  If  no  collisions 
are  found,  the  via  point  is  returned. 


from-surface 


Figure  42.  Neighbor  hypothesis  crearion  method. 
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The  strength  in  this  hypothesis  creation  method  is  two-fold.  First,  it  is 
extremely  simple  and  most  via  points  are  created  using  this  method.  Since  GD&T 
requires  the  creation  of  three  mutually  perpendicular  planes  and  many  tolerances 
require  more  than  one  surface  to  be  inspected,  most  collision  avoidance  routines 
simply  move  the  probe  around  an  edge  from  one  surface  to  another,  which  is  what 
the  neighbor  method  explicitly  queries  about  The  second  strength  is  that  the 
hypothesis  creation  method  looks  at  geometry  memory  pointers  or  soft-pointers 
within  the  pan-model  geometry  hierarchy  which  is  very  fast  The  hypothesis  creation 
does  not  actually  create  a  path  using  the  3-D  solid  modeler,  but  queries  the  Concept 
Modeler™  for  a  geometrical  relationship  based  on  surface  pointers  stored  in  memory. 
The  greatest  advantage  is  that  the  computationally  expensive  collision  testing  does 
not  occur  if  the  geometrical  relationship  is  not  present.  The  pseudocode  for  the 
neighbor  search  is: 


neighbor 

if  ( to-surface  and  from-surface  are  known) 
and  ( to-surface  *  from-surface),  then 
set  x  to  the  Boolean  intersection  of  the  set  of  all  edges  from 
both  to-surface  and  from-surface 
if  x  exits,  then 

set  via-point  to  (make-via-from-edge  x  pi  p2) 
if  dheck-for-incersecrion  of  new  path  returns 
true,  then 
return  via-poini 
else  rerum  false 


The  make-via-from-edge  function  returns  a  new  point  that  will  guide  the  path 
around  the  edge  geometry  it  is  given  as  its  input.  The  via  point  is  first  created  on  the 
edge  and  then  moved  an  offset  distance  from  the  edge  in  the  directions  of  the  normals 
of  each  surface  of  the  edge.  Its  pseudocode  is: 


ImM  X-STfa  1 MliiEn*  f 


set  via-poiru  to  the  midpoint  of  the  edge  line  x 
set  nj  and  nj  to  normals  of  surface j  and  surfaces,  respectively 
move  via-poiru  constrained  to  the  direction  along  the  edge  line  x  to 
the  avenge  of  p\  and  p2 

move  via-poiru  in  direction  for  nj  an  offset  distance 
move  via-poiru  in  direction  for  n?  an  offset  distance 
return  via-poiru 


If  the  neighbor  hypothesis  creation  method  failed  to  find  a  via  point,  then  the 
collision  avoidance  algorithm  calls  forth  the  two-doors-down  search.  It  hypothesizes 
a  collision- free  path  by  checking  for  a  single  surface  that  both  input  surfaces  have  as 
a  neighbor.  To  describe  their  relationship  as  a  cliche,  from-swrface  and  to-swrface  are 
‘two  doors  down”  or  ‘‘my  neighbor's  neighbor.”  This  is  the  next  level  of  solid 
modeler  query  from  the  previously  called  neighbor  search.  If  this  intermediate  sur¬ 
face  is  found,  then  two  via  points  are  created,  one  from  the  edge  connecting  to-sur- 
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face  co  the  intermediate  surface  and  one  from  the  edge  connecting  the  intermediate 
surface  to  from-surface.  If  this  hypothesized  path  has  no  collisions,  then  the  two  via 
points  are  returned. 


Figure  44.  Two-doors-down  hypothesis  creation  method. 


The  two-doors -down  check  is  performed  by  comparing  the  ‘superior-gecras” 
of  the  edges  of  both  the  initial  and  goal  surfaces.  The  superior-geoms  to  an  edge  line 
are  the  surfaces  that  cream  that  edge,  also  described  as  the  surfaces  that  the  edge  con¬ 
nects  together.  Therefore,  the  Boolean  intersection  of  the  set  of  surfaces  (superior- 
geoms)  of  the  edges  of  to-surface  and  from-surface  will  result  in  a  common  interme¬ 
diate  surface  to  which  both  are  neighbors.  The  pseudocode  is: 


two-4WTS-tep: 

for  each  edge  x  of  to-surface  do 
for  each  edge  y  of  from-surface  do 

set  z  to  the  Boolean  intersection  of  the  superior  geoms  of  x 
and  superior  geoms  of  y 
delete  to-surface  and  from-surface  from  z 
if  z  is  not  empty,  then 

set  i  to  point  on  z  between  p  j  and  P2 
set  via/ to  (make-via-from-edge  x  pi  i) 
set  via?  to  (make-via-from-edge  y  i  p2) 
if  total  proposed  path  is  collision- free,  then 
_ return  via  /and  via? _ _ _ 


Notice  that  again,  this  hypothesis  creation  method  does  not  loop  through  a  search 
blindly  looking  for  a  collision-free  path,  but  rather  performs  a  computationally  effi¬ 
cient  query  that  requires  looking  at  a  memory  look-up  table. 


If  the  two-doors-down  search  fails  to  find  a  collision-free  solution,  the  collision 


avoidance  algorithm  invokes  the  2-level-geometry- 1  method.  This  method  got  its 
weird  name  because  it  searches  through  two  levels  of  geometry  (2-level-geometry...) 
but  requires  only  the  initial  surface  to  be  known  (...- 1).  Its  approach  is  more  like  a 
true  hypothesize  and  test  search  algorithm.  However,  since  it  is  known  that  a  colli¬ 
sion-free  path  is  always  obtainable  with  only  three  sub-paths  (two  via  points),  this 
method  will  terminate  its  search  and  return  failed  if  a  path  is  not  found  after  two  lev¬ 
els  of  search. 


levei  1  searcn 


Figure  45.  2-level-geometry- 1  hypothesis  creation  method. 


The  2-levei-geometry-l  method  loops  through  each  edge  of  from-surface,  cre¬ 
ates  a  via  point,  and  hypothesizes  a  path  from  the  initial  point,  to  the  via  point,  and 
then  to  the  goal  point  (level  1).  If  the  proposed  path  is  collision-free,  then  the  via 
point  is  returned:  otherwise,  the  surfaces  intersected  are  tested  for  their  relationship. 
If  the  surfaces  intersected  by  the  level  1  hypothesis  path  have  a  common  edge,  then 


that  common  edge  will  supply  the  other  via  point  (level  2)  and  create  the  new  hy¬ 
pothesized  path.  If  the  path  containing  the  two  via  points  search  is  tested  false  for 
collision  detection,  then  the  two  via  points  are  returned.  The  pseudocode  is: 


level- 


set  x  to  the  edges  of  from-surface 
for  each  edge  y  (a  sub-geom)  of  x  do 

setvjto  (make- via- front-edge  y  pi  p2) 
set  z  to  set  of  surfaces  intersected  by  path  from  pj  to  vj  to  P2 
if  z  is  empty,  then 
return  vj 

if  (length  of  z  =  2)  and  (there  exists  a  common  edge  to  surfaces 
in  z),  then 

setV2to  (make- via- from-edge  y  vl  p2) 
set  p  to  the  path  from  pj  to  v;  to  V2  to  P2 
if  (check-for-interseetion  p)  returns  true,  then 
_ return  v/  and  V2 _ 


Search  #4;  Up-and-over  Hypothesis  Creadon  Method 
.  The  final  method  called  forth  by  the  collision  avoidance  algorithm  is  the  up- 
and-over  method,  which  is  guaranteed  to  produce  a  collision-free  path  based  on  the 
utilization  of  how  the  inspection  points  are  placed  in  a  setup  orientation.  As  dis¬ 
cussed  in  section  4.1.3,  an  MR  is  placed  into  a  setup  object  only  if  all  inspection 
points  pass  the  visibility  and  accessibility  criteria.  This  ensures  that  the  probe  can 
safely  reach  the  inspection  point  from  above  the  offset  safe  plane.  By  definition  of 
the  offset  plane,  the  probe  may  navel  safeiy  throughout  the  entire  plane.  Therefore, 
a  collision-free  path  can  be  defined  from  an  initial  point,  “up”  to  the  offset  plane, 
travel  within  the  offset  piane  directly  above  the  goal  point,  and  then  descend  “down” 
directly  to  it. 
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Figure  46.  Up-and-over  hypothesis  creation  method. 


The  up-and-over  hypothesis  creation  method,  as  is  the  case  for  the  first  two 
methods,  does  not  perform  a  looping  search  of  possible  paths,  but  it  neither  inquires 
about  pan-model  geometry  nor  checks  its  path  for  collisions.  It  is  called  only  after 
all  sensible  attempts  to  determine  a  collision- free  path  have  already  been  executed.  It 
performs  the  function  of  satisfying  the  primary  and  critical  requirement  of  inspection 
path  planning:  to  establ  ish  a  collision-free  {mb. 


up-and-qycn 

set  VJ  to  a  copy  of  pj 

move  vl  into  offset  safe  plane  (directly  “up”) 
set  V2  to  a  copy  of  p2 
move  \>2  into  offset  plane  (directly  “up”) 
return  vj  and  V2 


4.33.  Plan  Simulation 

The  popularity  of  process  plan  simulators  for  inspection  and  manufacturing  re¬ 
iterates  the  importance  of  collision-free  paths.  Interpreting  the  code  and  displaying 
its  results  allows  the  inspector  to  foresee  potential  problems,  inaccuracies,  and  overall 
efficiency.  This  capability  is  especially  important  due  to  the  difficulty  of  interpreting 
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CMM  code  (even  greater  so  for  automatically  generated  CMM  code)  and  the  exorbi¬ 
tant  cost  of  replacing  the  probe  head,  if  damage  should  occur  in  a  collision. 

The  IPEM  provides  a  CMM  path  simulator  in  which  the  trajectory  of  the  probe 
is  overlaid  on  top  of  the  pan-model.  This  research  also  allows  for  collision  de  tec  ion 
within  the  simulator,  with  the  colliding  paths  highlighted  in  red.  This  technique  pro¬ 
vides  a  double  check  to  the  collision  avoidance  algorithm  as  an  assurance  that  the 
code  is  safe. 

The  format  for  the  simulator  is  also  aesthetically  pleasing  to  the  engineer.  The 
RDS  pan-model  display  window  is  divided  into  four  sub-windows,  each  containing  a 
different  view  of  the  pan-model  and  the  overlaid  probe  path.  The  layout  resembles 
an  engineering  drawing  with  top,  front,  and  side  views,  but  also  includes  a  3-D 
isometric  view.  A  text  window  displays  the  current  inspection  plan  infarmahon,  such 
as  setup  number,  DRF  description,  and  feature/toierance  combination. 


Figure  47.  The  simulation  layout  within  the  RDS. 


4.3.4.  Plan  Translation 

This  thesis  has  brought  the  inspection  planning  process  to  its  final  step  —  gen¬ 
erating  the  output.  The  desired  output  format  is  computer-controlled  CMM  instruc¬ 
tion  code  for  automated  inspection.  The  current  state  of  the  inspection  plan  is  repre¬ 
sented  by  sequenced  setup- DRF-MR  structures  consisting  of  optimized  and  collision- 
free  measurement  points.  Plan  translation  between  these  two  states  has  been  imple¬ 
mented  as  a  two-step  process:  translate  the  serup-DRF-MR  structures  into  a  generic 


96 


plan  representation  called  “metacode,”  and  then  translate  the  metacode  into  the  CMM 
code.  The  metacode  is  generated  for  several  reasons: 

1.  the  inspection  plan  is  represented  by  the  metacode  in  a  “friendly”  or  condu¬ 
cive  format  for  CMM  code  generation,  whatever  the  particular  CMM  lan¬ 
guage; 

2.  the  inspection  plan  in  metacode  representation  may  be  saved  and  retrieved 
from  disk; 

3.  the  metacode  structure  can  be  easily  altered  to  suit  the  needs  of  the  inspec¬ 
tor,  inspection  machines,  and  inspection  techniques  as  they  change,  without 
requiring  a  total  rework  of  the  1PEM;  and 

4.  the  text  and  numerical  values  of  the  metacode  can  be  easily  edited  by  the 
inspector  for  quick  code  regeneration,  rather  than  destroying  and 
reinstantiating  new  whole  new  setup-DRF-MR  structures. 

The  metacode  received  its  name  because  it  is  a  code  that  describes  another  code,  Le., 
the  desired  CMM  code.  The  metacode  representation  removes  the  internal  memory 
pointers  to  feature  and  geometry  instantiations  (geoms)  from  the  inspection  plan  and 
replaces  them  with  generic  values  in  the  form  of  text  or  numbers,  which  allows  the 
storage  and  retrieval  of  the  plan  for  future  editing  and  re-generation  by  the  inspector. 
Minor  editing  on  the  metacode  (coined  “tweaking”)  is  probably  unavoidable  for  most 
inspection  plans,  including  such  things  as  fixture  avoidance,  intelligent  point  place¬ 
ment  among  intersection  features,  and  extra  probe  degrees  of  freedoms  which  are  not 
yet  implemented  in  the  current  research.  Without  metacode  representation,  the  entire 
inspection  process  planning  would  have  to  start  anew  from  the  FBDE  every  time  an 
old  plan  needed  revision. 
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MR  to  Meacode  Translation 

The  metacode  is  creaied  from  the  MRs  in  the  setup-DRF-MR  inspection  plan 
representation  generated  by  the  process  planner  (section  4.1).  The  key  to  the  effi¬ 
ciency  of  this  feature  translation  is  the  object  oriented  software  of  CL  OS  (Common 
LISP  Operating  System).  In  CL  OS,  methods  are  defined  based  on  the  class  defini¬ 
tion  of  the  argument  passed.  As  a  quick  example,  consider  a  software  control  for  the 
hydraulic  pumps  in  a  mechanic's  shop.  Many  methods  named  raise-car  (they  all 
have  the  same  defined  method  name)  would  be  defined  describing  what  motor  torque 
and  height  to  use  when  raising  a  car  based  on  the  type  of  car  class  that  was  used  as 
the  method's  parameter.  Therefore,  the  proper  raise-car  method  will  be  executed 
based  on  the  class  of  its  input  argument,  whether  the  car  is  an  Integra  or  an  Impaia. 

The  MR  to  metacode  translation  algorithm  calls  a  method  named  generate- 
metacode-4this-tol&f  eat  and  passes  an  MR  instantiation.  There  are  many 
different  methods  with  this  name,  each  of  which  is  defined  to  recognize  an  MR  object 
by  the  class  of  its  tolerance  feature  and  its  design  feature.  For  example,  a  call  with  a 
position  tolerance  and  hole  feature  will  execute  a  different  method  definition  than  a 
call  with  a  concentricity  tolerance  and  hole  feature.  Defining  a  method  based  on  two 
or  more  classes  is  described  further  by  Keene  (1989). 

This  translation  is  not  a  1:1  ratio.  The  MR  is  designed  to  efficiently  represent 
one  aspect  of  the  inspection  plan  —  the  measurements.  The  metacode  is  designed  to 
efficiently  represent  the  tolerance  evaluation.  The  metacode  consists  of  three  types  of 
measurement  and  evaluate  commands: 
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1.  measure  and  evaluate; 

2.  measure,  evaluate,  and  save  the  measurement  values  for  later 
evaluation;  and 

3.  use  saved  points  from  previously  saved  measurements  to  perform  a 
different  evaluation  function. 

One  process  involved  in  the  MR  translation  to  metacode  is  that  the  inspection 
points  are  translated  into  their  proper  setup-DRF  orientation.  Within  the  MR,  all  in¬ 
spection  points  are  created  with  reference  to  the  internal  origin  of  the  CAD  system, 
which  is  defined  to  be  the  center  of  mass  of  the  part-model.  GD&T  requires  the  ori¬ 
gin  of  the  measurements  to  be  at  the  intersection  of  the  three  datum  planes. 

Before  translation  of  the  inspection  points,  the  DRF  origins  must  be  calculated 
with  respect  to  the  internal  CAD  origin.  This  defines  the  translation  vector  needed  to 
move  each  point  into  the  DRF  reference  frame.  However,  when  axis  datmm  are  in¬ 
troduced.  the  planes  of  the  coordinate  frame  become  slightly  obscure  since  an  axis  is 
contained  by  an  infinite  number  of  planes.  Therefore,  inspection  algorithms  are  used 
to  define  the  directions  of  the  coordinate  frame  planes. 


onqm 


PAP  Datum  Reference  Frame 


secondary  plane 
inferred  from 
direction  of 
tertiary  plane 


Figure  48.  Origin  and  axes  creation  defined  from  the  datum  of  the  DRF. 
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need  the  theoretical  center  of  the  hole  and  the  diameter.  The  CMM  will  automati¬ 
cally  move  to  the  center  and  probe  three  or  four  points  at  120°  or  90°  apart,  respec¬ 
tively.  The  MR  does  aot  contain  this  information,  but  rather  actual  inspection  points 
on  the  inside  surface  of  the  hole,  which  is  inefficient  for  most  automated  CMM  pro¬ 
gramming. 


43.5.  Code  Generation 

The  automated  generation  of  the  CMM  code  is  simple  due  to  the  structure  of 
the  metacode  and  the  ready-to-use  information  it  contains.  Any  number  of  code 
generators  can  be  called  by  the  inspector  to  generate  the  desired  output  format. 
Currently,  CMES  is  the  only  supported  code  generadon  format,  but  future  implemen¬ 
tations  will  include  DMIS  and  manual  inspection  representations. 

Implementation 

Since  this  thesis  is  concerned  with  using  the  inspection  rule  based  ANN  to 
sequence  the  inspection  points  (section  4.22),  the  CMM  code  generator  follows  the 
plan  structure  of  Figure  29(c)  on  page  55.  Macros  are  filled  with  variables  from  the 
metacode  data  slots  to  output  the  code  in  the  proper  format.  Appendix  A  shows  die 
macros  used  to  output  the  CMES  codes  from  the  design  feature/toieiance  feature 
combinations  stored  in  the  metacode.  The  IP  EM  also  has  the  ability  to  output  the 
plan  structure  of  Figure  29(a),  if  the  two-level  nearest  neighbor  search  is  used  to 
sequence  the  inspection  points  (section  4.2.1). 

One  final  feature  is  that  the  code  generator  can  also  perform  functions  to  con¬ 
figure  the  CMM  code  into  a  particular  appearance  desired  by  the  inspector.  This  re¬ 
search  added  another  inspection  point  transformation  at  the  request  of  the  end-user. 
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the  QA  engineers  at  the  Air  Force  4950th  Test  Wing,  who  desired  a  consistency  in 
the  coordinate  frame  for  all  setups.  Even  when  the  product  rotates  on  the  table,  the 
QA  engineers  want  the  x-y-z  axes  to  still  point  in  the  same  direction.  Their  request 
was  for  z  to  point  “up,”  y  to  point  “left,”  and  x  to  point  “back.”  To  accomplish  this 
configuration,  the  setup  orientation  matrix  is  used  backwards  to  rotate  the  coordinate 
frame  from  the  perspective  of  the  pan-model,  ratter  than  the  pan-model  and 
coordinate  system  from  the  perspective  of  the  viewer. 

|  o' 

jo  (4.16) 

! 0 

o  o  oTT 
The  result  puts  the  product  into  the  setup  (mentation  with  the  coordinate  frame 
matching  the  internal  CAD  coordinate  frame.  Since  the  internal  CAD  orientation  and 
QA  desired  oneniahon  are  both  constants,  a  standard  frame  rotation  allows  the  trans¬ 
formation  between  them. 


/t*(90.-90) 


•1 

oi 


1 1 
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CAD  default  part  in  setup  onenzation.  part  in  setup  orientation. 

frame  in  CAD  default  frame  mQC  desired 

orientation 


Figure  50.  Pan-model  and  axes  rotation  from  CAD  default  to  inspector 
desired  orientation. 


The  automatically  generated  CMM  code  that  evaluates  the  tolerances  on  the 
pan-model  simulated  in  Figure  47  on  page  95  is  shown  below: 


CMES  program  to  inspect  the  pan 
"hoomer  panel" 

Created  on  1137:37  7/11/1992. 

Description:  boomer  panel  for  fuel  refill 
Inspector  siever 

Motes  to  instructor  for  setup: 

1.  .Aligned  the  pan  with  the  primary  datum 
surface  on  the  cmm  table,  the 
secondary  datum  facing  the  inspector 
(computer),  and  the  ternary  datum 
facing  to  the  left  (the  door; 

TI  to  continue 

ET 

RONFEPiP:\SUMN 

PAXP-.'PA 

OP\DT 


Setup  #1 

!  Prompt  operator  to  clear  PH  10  probe 


DA 

WWWW 

Move  probe  dear  of  obstructions 

WWWW 

Enter  TI  when  ready  to  continue 

WWWW 

!  Paused  to  wan  for  operator  response 
ET 

!  Re-Index  PH10  Probe  Head 
UR.1.PH 

!  Continue  Inpecdon  Program 

WWWW 

Take  3  touches  on  the  TOP  of  the  TABLE 
SURFACE  -z-  CCW 
AX-2 

Take  2  touches  on  the  FRONT  surface, 
RIGHT  FIRST 
M1-JC2 

Take  1  touch  on  the  LEFT  end  of  the  pan 

M2-.YXZ 

PISMDVSA2 
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wwww 

MOVE  PROBE  CLEAR  OF 
OBSTRUCTIONS.  TI  TO  CONTINUE 
ET 

/Tvr>^ ’  t  ope  ;  p\ 

tolerance  in  DRF-1 
setup  *1,  CMES  #1 


#MCV14.13<M.772U100 

4PT2N0.000 

#MCV14.13<N-9.772M).100 

#MCV1.271V0.854M3.100 

#PT2'0.OOO 

#MCV1.271V0.854'0.100 

#MCrl4.995V9.151N0.100 

#PT.20.000 

4MCV14.995V9. 15 IV).  100 
AX-2 

(DTM-2  B  DRF-1  S)  with  Datum 
tolerance  in  DRF-1 
setup  #1.  CMES  #2 


#MCvl9.108yO.10OV0.0l6 

#PT,Y'0.000 

#MCV  19. 108N0. 10GM).016 

#MCV9.87CN).1(XM)J00 
#PT,YV0.000 
4MCV9.87(N).  10CW).500 

N1-.Y2 

(DTM-3  C  DRF-1  R)  with  Datum 
tolerance  in  DRF-l 
setup  #1.  CMES  #3 


4MC0.100V5.509V0.500 

4PTJCO.OOO 

4MC0.10CN-5.509V0.500 

N2-X.Y2 

PIVMENSAJ 


DRF-1  creates  a  new  on  gin  to  which  ail 
points  from  now  on  refer . 


vi*-pomi(s) 


#MCO.  10CN5  -5090. 1 00 
*MC  1000^-?.0000.’°0 

TH-6  with  Position  tolerance  in  DRF-1 
setup  #1.  CMES  #9 


4ID2///V 1 0JXXM.00(A 
-0-50CA1  J00.0.01.0.01N5.0E-4 
#MC2^0.!00 

TH-2  with  Position  tolerance  in  DRF-1 
setup  #1.  CMES  #7 


«D2VM  0.000*2.000. 

-0-50Osl  .500.0.01 .0.01N5.0E-4 
#MC2'0-100 

TH-3  with  Position  tolerance  in  DRF-1 
setup  #1.  CMES  #6 


#lD2//A-20.000r2-0<XA 

-OJ01M-500.0.01.0.01\5.0E-4 

#MC2V).1Q0 

TH-7  with  Position  tolerance  in  DRF-1 
semp  #1.  CMES  #4 


iID.Z//A-20.000*8.000i 
-0_50<M  .500.0.01 .0.0 1V5.0E-4 
4MC2VUOO 

BH-2  with  Position  tolerance  in  DRF-1 
setup  #1.  CMES  #5 


#ID2//A-24.000r5.00Ch 

-0.l5CM.000,0.01.0.01V).0l 

4MC2v0.100 

BH-1  with  Position  tolerance  in  DRF-1 
setup  #1.  CMES  #8 


4ID.Z//M5.000V5.00CN 

-0.15CM.000.0.01.0.01V).01 

4MC20.100 


BH-3  with  Position  tolerance  in  DRF-1 


setup  #1.  CMES  #10 


#IDJZ//A^.00(M.(XX> 

-0. 13CN1 .000,0.01 ,0.0 l'O.Ol 
#MCTO.lOO 


Chapter  5 
Results 


We  have  too  many  high  sounding  words, 
and  too  few  actions  that  correspond  with  them. 

-  Abigail  Adams 


This  chapter  will  re -illustrate  the  performance  of  the  EPEM  by  showing  all  as¬ 
pects  of  the  intelligent  inspection  system.  A  single  product  design  will  be  taken  from 
CAD  creation,  through  the  IPEM,  and  finally  to  executable  CMM  code.  Monitor 
snapshots  of  the  process  will  show  both  internal  representations  as  well  as  the  human 
interfaces,  and  actual  text  results  will  be  displayed. 

The  product  is  created  in  the  FBDE,  the  feature-driven  CaD  module  of  the 
RDS  (section  2.1).  For  this  part-model,  the  designer  added  negative-volume  features 
to  a  positive-volume  rectangular  starting  block.  Two  blind-hole  features  and  one 
pocket  feature  are  attached  to  the  starting  block,  and  another  two  blind-hole  features 
are  attached  to  the  bottom  of  the  pocket 
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Figure  51.  The  Feature  Based  Design  Environment. 


The  designer  also  places  the  GD&T  callouts  onto  the  pan-model  by  attaching 
them  to  features  or  sub-features,  i.e.,  surfaces  of  features.  Figure  52  shows  the  toler¬ 
ance  callouts  of  the  pan-model.  Since  the  FBDE  does  not  currently  display  the  toler¬ 
ance,  GD&T  feature  control  frames  were  graphically  overlaid  on  top  of  the  snapshot 
of  Figure  51. 
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am**, » 

Figure  52.  Tolerances  overlaid  on  pan-model. 

Assuming  that  the  product  has  been  fabricated  by  the  manufacture  engineers 
using  the  FAB-PLAN  module  of  the  RDS,  the  workpiece  is  given  to  the  QA  engi¬ 
neers  who  locate  the  pan-model  in  the  RDS  database  and  bring  it  into  the  IPEM.  The 
IPEM  has  the  same  window  layout  as  the  FBDE  (Figure  51);  therefore.  Figure  53 
shows  the  new  button  menu  of  the  IPEM  layout 


Figure  53. The  button  menu  of  the  Inspection  Planning  and  Evaluation 
Module  layout 


To  stan  the  automated  inspection  planning,  the  Inspection  Plan  button  is 
clicked  on  by  the  inspector  (Figure  53).  The  IPEM  begins  to  execute  through  ail  the 
steps  outlined  in  section  4.1:  stable  surface  location,  setup  creation,  MR  creation,  and 
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setup  population.  Messages  displayed  to  the  inspector  indicate  the  currently  active 
step.  Other  than  that,  nothing  else  is  displayed  due  to  the  large  increase  in  execution 
time  that  entails  displaying  the  geometries. 

Once  the  process  planner  has  represented  the  inspecdon  plan  by  the  setup-DRF- 
MR  structures,  the  schedule  opdmizadon  begins  by  generating  the  three  inspection 
rule  matrices: 

W  matrix: 


0.000 

1.000 

0.632 

0.671 

0.281 

0.614 

0.700 

0.571 

1.000 

0.000 

0.407 

0.407 

0.736 

0.463 

0.33C 

0.463 

0.632 

0.407 

0.000 

0.245 

0.407 

0.253 

0.137 

0.061 

0 .  C71 

0.407 

0.245 

0.000 

0.407 

0.061 

0.137 

0.253 

0.281 

0.738 

0.407 

0.407 

0.000 

0.352 

0.447 

0.352 

0.814 

0.463 

0.253 

0.061 

0.352 

0.000 

0.173 

0.245 

0.700 

0.330 

0.137 

0.137 

0.447 

0.173 

0.000 

0.173 

0.571 

0.463 

0.061 

0.253 

0.352 

0 .245 

0.173 

0.000 

t  matrix: 


-0.667 

0.333 

1.000 

1.000 

0.333 

i.aoo 

1.000 

1.000 

0.667 

-1.000 

0.000 

0.000 

-1.000 

0.667 

0.667 

0.667 

0.667 

0.333 

-0.667  -0.667 

0.333 

0.667 

0.667 

0.667 

0.667 

0.333 

-0.667  -0.667 

0.333 

0.667 

0.667 

0.667 

0.667 

-1.000 

0.000 

0.000 

-1.000 

0.667 

0.667 

0.667 

0.667 

1.000 

0.667 

0.667 

1.000 

-0.667 

-0.667 

-0.667 

0.667 

1.000 

0 . 667 

0 . 667 

1.000 

-0.667 

-0.667 

—0 . 667 

0.667 

1.000 

0.667 

0.667 

1.000 

-0.667 

-0.667 

-0 . 567 

5  matrix: 

10000000 
01100000 
00011111 
0001111  1 
01100000 
00011111 
00011111 
00011111 

See  Figure  36  on  page  73  for  a  review  of  what  the  matrices  represent.  The  IPEM 
then  makes  a  call  to  the  ANN  program  (Appendix  B)  to  execute  the  optimization 
scheduling  using  inspecdon  rules  on  the  measurement  points.  The  resultant  path 
trajectory  is  then  displayed  to  the  screen.  Figure  54  shows  the  RDS  display-window; 
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however,  sequence  numbers  were  overlaid  onto  the  snapshot  to  help  clarify  the  path 
trajectory  to  the  reader. 


Figure  54.  Results  from  artificial  neural  network  schedule  optimization. 

This  path  represents  adherence  to  the  inspection  rules  described  in  section  4.2.2.  The 
first  two  blind  holes  measured  have  a  tolerance  value  smaller  than  the  inspector-de¬ 
fined  “tight”  tolerance;  therefore,  these  measurements  should  go  before  any  other 
tolerance  in  the  inspection  plan  according  to  the  rightness  inspection  rule.  The  ANN 
was  driven  to  this  solution  by  the  tightness  rule  influencing  the  S  and  F  matrices. 

The  two  blind  holes  attached  to  the  bottom  of  the  pocket  are  measured  next  because 
they  are  of  the  same  feature  type  as  the  previous  blind  holes,  as  required  by  the 
feature  inspection  rule  and  implemented  into  the  F  matrix.  Finally,  the  three 


no 


remaining  inspection  points  are  measured  according  to  a  minimum  Euclidean 
distance  criterion  implemented  in  the  W  matrix. 

At  this  point,  the  optimized  path  intersects  the  part-modeL  The  collision  avoid¬ 
ance  algorithm  is  now  executed;  it  first  asks  if  user  interaction  breaks  are  desired 
within  the  algorithm.  These  breaks  allow  the  inspector  to  accept  a  proposed  path,  or 
reject  it  by  telling  the  algorithm  to  keep  searching  for  a  different  collision-free  path. 
This  is  useful  in  the  2-level-geometry- 1  search  where  one  edge  might  produce  an 
acceptable  collision-free  path,  but  the  inspector  can  clearly  see  that  a  yet  untested 
edge  will  produce  a  better  path.  Figure  55  shows  the  collision  avoidance  algorithm 
results,  again  with  text  overlaid  on  the  graphic  to  clarify  the  paths  to  the  reader. 


Figure  55.  Collision  avoidance  algorithm. 


Ill 


The  MR  representation  of  the  inspection  plan,  with  the  inspection  points  opti¬ 
mized  and  the  via  points  created,  is  sent  to  the  automated  CMM  code  generator.  First 
the  MR  representation  is  translated  into  metacode  representation.  A  “pretty-printer" 
output  of  the  metacode  is  shown  below.  The  :  and  ...  symbols  represent  truncated 
code,  deleted  due  to  redundancy,  since  all  metacode  instantiations  have  the  same  slot 
structure. 


Inspection  Plan: 
Inspector  "stever" 
Part  name:  "path-bar" 


isetup-number  1 

Inonnal-of-resting-surface:  (0.0  1.0  0.0) 
lorientation-matrix:  (0.0  0.0  0.0) 

Idrf- lists:  1  total 


I*  New  DRF 


Idrf-number.  1 
Idrf-name:  DRF-1 
Idrf-label:  ABC 
Idrf-type:  PPP 
(primary -datum: 
l_ 

llfeature-type:  PLANE 
lltolerance-type:  DTM 
lldrf:  DRF-1 
llapproach-vector  3 
llpts-lisc  ((3.6296-1.0  1.0832) ...) 
Iloffset-pts-lisu  ((3.6293  -1.1  1.0832) 
llcmm-pts-lisc  (...) 
Ilcmm-otfset-pts-lisc  (...) 

Iltol- value:  P 
llmat-cond:  NIL 
llnum-points:  3 

llfeature-name:  (DTM-1  A  DRF-1  P) 
llfeature-dims:  NIL 
llsave-meas?:  NIL 
llsetup-number  1 
lldrf-number  1 
llmr-number  1 
llsurface:  268439487 
ilvia-points:  NIL 
llvia-method:  NIL 


II- 

llsecondary-datum: 

II  : 
ll_ 

II- 

lltertiary-danim: 

II 

ll_ 

lime tac ode-lists:  5  total 
ll_ 

lllfeamre-type:  HOLE 

intolerance -type:  PO 

I  Udrf.  DRF-1 

I  Ilapproach- vector  2 

I  llpts-lisc  ((30. 0.5  0.0)) 

lltoffset-pts-lisc  ((3.0  1.1  0.0)) 

lllcmm-pts-lisc  ((-8.0  -2.5  1-5)) 

lllcmm-otfset-pts-lisc  ((-8.0  -2-5  2.1)) 

llltoi-value:  1.0E-5 

lllmat-cond:  NONE 

lllnum-points:  3 

lllfeature-name:  BH-2 

lllfeamre-dims:  (1.0  1.0) 

lUsave-meas?:  MIL 

lllsetup-number  i 

llldrf-number  1 

lllmr-number  4 

IDsurface:  268439269 

lllvia-points:  NIL 

lllcmm-via-points:  NIL 

lllvia-method:  NIL 

II- 

ll_ 

lllfeature-type:  HOLE 
intolerance-type:  PO 

III 

lllfeature-name:  BH-3 
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ill 

ii- 


il_ 

lllfeature-iype:  HOLE 
llltolerance-type:  PO 
III 


tllfeature-name:  BH-4 


ll_ 

llifeature-type:  HOLE 
llltolerance-type:  PO 
IU 


Wfeaturc-name:  BH-1 

»i  ■ 

ii- 

ii 


iHfeatnte-type:  T 
IHioierancc-type:  DTM 
III 

lllfeature-name:  PKT1[5] 

hi  •: 

i- 

Itan-via-points:  ((-5.1  1.1  -.855)...) 
Iltm-seqtieace-points:  (3  0704  050608 ...) 
I- 

mmmax-box:  ((-5.0  5.0)  (-1.0  1.0)  (-15  15)) 
office  0.1 

cnun-languagc  CMES 
cmm-accuncy:  0.00001 
drf-origio-iisc  ((DRF-1  (-5.0  -0.1 15))) 
drf-axes-lisc  ((DRF-1  (3  4  1))) 


The  CMES  code  is  then  generated  from  the  metacode.  The  inspector  is 
prompted  for  a  filename  into  which  the  text  is  placed.  This  file  will  then  be  taken  to 
the  CMM  computer  controller  either  by  diskette,  modem,  or  network  transfer.  The 
program  will  be  downloaded  to  the  CMM  language  interpreter,  CMES,  and  executed 
to  inspect  the  workpiece. 


CMES  program  to  inspect  the  part  ’path-bar" 

Created  on  14:30:34  6/11/1992. 

Description:  bar  pan  for  placing  NN  path  over 

Inspector  stever 

Notes  to  instructor  for  setup: 

1.  Aligned  the  part  with  the  primary  datum 
surface  on  the  emm  table,  the 
secondary  datum  facing  the  inspector 
(computer),  and  the  tertiary  datum 
facing  to  the  left  (the  door) 

TT  to  conunue 
ET 

RC\NP\EPJ_P:\S  IMN 

PAXP:\PA 

OPSDT 


Parc  path-bar 

Description:  bar  panforplacutg  NN  path  over 


Inspector  stever 
Setup  #1 

!  Prompt  operator  to  clear  PH  10  probe 
DA 

WWWW 

Move  probe  clear  of  obstructions 

WWWW 

Enter  TI  when  ready  to  conunue 

WWWW 

!  Paused  to  wait  for  operator  response 
ET 

!  Re-Index  PH10  Probe  Head 
UR.1PH 

!  Continue  Inpecdon  Program 

WWWW 

Take  3  touches  on  the  TOP  of  the  TABLE 
SURFACE -z-CCW 
AX-Z 
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Take  2  touches  on  the  FRONT  surface. 
RIGHT 
FIRST 
Nl-XZ 

Take  1  touch  on  the  LEFT  end  of  the  pan 
N2-.YXZ 
PIXMDXSA^ 

WWWW 

MOVE  PROBE  CLEAR  OF 
OBSTRUCTIONS,  TI  TO  CONTINUE 
ET 

Re-creating  damns  for  DRF-1 

(DTM-1  A  DRF-1  P)  with  Datum  tolerance  in 
DRF-l 

setup  #1,  CMES  #1 


#MC\1.417V8.629\l-200 

#PT7M.100 

#MC\1 .4 1 7X-8.629M  .200 

#MC4.886V4.71CMJZ00 

#PT.ZX1.100 

#MCX4.886X^.7101.2OO 

#MO0.427V0.424X1.2Q0 
#PT2M.100 
#MC0.427V0.424\1 200 

AX+.Z 

via-poim(s) 

4MCX-0. 100-2.71 1X1.200 

(DTM-2  B  DRF-1  S)  with  Datum  tolerance  in 
DRF-l 

setup  #1,  CMES  #2 


4MCV0. 1O04.998W.887 

#PT.XSO.OOO 

#MCV0. 1O0-4.998W.887 

#MCV0. 100-6.3601.069 

#PT^CO.OOO 

#MCV0. 100-6.3601.069 

N1+.X.Z 


#MCVO.  lOONO.  1000.978 

(DTM-3  C  DRF-1  R)  with  Datum  tolerance  in 
DRF-l 

setup  #1.  CMES  #3 


#MC3.355W. 1000.887 
#PT,YW.OOO 
#MC3J355'0. 1000^87 

N2-.Y.XZ 

PIXMENSAJ 

DRF-1  creates  a  new  origin  to  which  all 
points  from  now  on  refer. 


via-point(s) 


#MC\3.355'0. 1001 .200 
#MC\2_5O02.QO0d.2QO 

BH-1  with  Position  tolerance  in  DRF-1 
setup  #1,  CMES  #7 


#n>2//ACL5O0 

-2.OO0O.6O0d. 000,0.01,0.01X1  .OE-5 
#MC2M200 

BH-2  with  Position  tolerance  in  DRF-1 
setup  #1,  CMES  #4 


#n>2//AOJO0 

-8.0000.6001.000.0.01.0.01X1 .OE-5 
#MCZX1200 


via-point(s) 


#MC2JO0-8.OO0l.2OO 

#MO3J(XM.OO01.2OO 

BH-3  with  Position  tolerance  in  DRF-1 
setup  #1.  CMES  #5 


#ID2//A3 .500-5.000 
-0. 1 500.500,0.01 .0.01X0.0 1 
4MCZO200 


via-point(s) 


BH-4  with  Position  tolerance  in  DRF-1 
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setup  #1.  CMES  *6 


*ID.Z//Al~50<M.00fc 

-0. 1500.500.0.0 1.0.0NX01 

#MC.Z\0.200 


#MC\1-50CM.50(NX200 

#MC3-5(XMJ0O0J200 

#PTXO.lOO 

#MCN3_50CM_50a0200 

#MC2J0Or5-50CN)^00 

#PT,Ztf.lOO 

*MC&50tM-S0(HX200 

FF,  ZyPL'ODKMOXXX) 


STARTING-  BLOCK  with  Flatness  tolerance 
in  DRF-1 

setup  #1.  CMES  #8 


#MC\1J0CM  .3000200 
#PT2?0.100 


When  the  IPEM  has  completed  the  CMES  code  generation,  the  inspector  can 
perform  two  aids  provided  by  this  research.  First,  the  inspector  can  now  save  the 
metacode  to  disk.  When  the  Save  Plan  button  is  clicked  by  the  mouse,  the  inspector 
is  prompted  for  a  file  name  to  place  the  metacode  into.  If  the  CMM  code  needs  to  be 
regenerated,  or  the  metacode  needs  editing,  the  file  can  be  retrieved  from  the  storage 
file  and  save  the  inspector  a  lot  of  time  rather  than  performing  the  process  planning 
again.  The  Retrieve  Plan  button  performs  this  function. 

Secondly,  the  inspector  can  click  on  the  Display  Points  St  Path  button  to  start 
the  CMM  simulation.  This  brings  up  the  four-view  engineering  design  layout  and 
overlays  the  probe  trajectory  onto  the  pan-model 
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Chapter  6 
Conclusions 


Research  is  to  see  what  everyone  else  has  seen, 
and  to  think  what  nobody  has  thought. 

-  Dr.  Albert  Szent-CyGryi 


The  outcome  of  this  research  is  a  number  of  accomplishments  seen  from  many 
different  perspectives.  Significant  results  have  been  produced  in  several  areas  of 
research. 

Looking  at  the  larger  picture,  this  research  has  had  a  large  pan  in  producing  a 
viable  automated  inspection  planner  that  is  integrated  into  the  RDS,  a  feature-based 
concurrent  engineering  system.  The  implemented  work  of  this  thesis  has  convened 
the  IPEM  from  a  research  idea  only  into  an  application  that  produces  usable  results 
and  provides  benefits  to  its  users. 

From  the  perspective  of  scheduling  optimization,  the  use  of  two  different  forms 
of  rule-based  matrices  to  integrate  rules  into  an  artificial  neural  network  is  unprece¬ 
dented.  Three  different  rule-generated  matrices  were  implemented  into  the  neuron 
motion  equation  of  the  ANN.  The  output  produced  modeled  the  desired  results  and 
sequenced  the  inspection  points  using  inspection  rule  criteria. 

A  new  approach  to  producing  collision-free  paths  was  also  introduced.  The 
collision  avoidance  algorithm  modified  the  generic  hypothesize  and  test  method  into 
a  computationally  efficient  algorithm  based  on  an  automated  inspection  paradigm. 
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Four  different  hypothesis  creation  methods  were  implemented,  each  with  a  quick 
search  or  pan-model  query  for  a  typical  geometrical  relationship  between  the  initial 
and  goal  points.  If  that  relationship  is  found,  then  the  method  can  efficiently  produce 
the  via  points  needed  to  create  a  collision-free  path. 

Simulating  the  plan  before  automated  inspection  ensures  the  inspector  that  the 
probe  path  is  safe  and  efficient  The  inspector  can  double  check  the  output  of  the 
point  scheduling  and  collision  avoidance  algorithms  for  desired  results.. 

Representing  the  inspection  plan  in  metacode  format  ensures  an  easy  upgrade 
in  the  DPEM  for  future  additions  to  output  formats.  The  metacode  also  provides  for 
storage  and  retrieval  functions.  Editing  capabilities  can  be  efficiently  performed 
through  the  use  of  the  metacode  instantiations  which  do  not  contain  internal  memory 
structures. 

The  automatic  generation  of  CMM  code  uses  a  metacode  to  CMES  generator. 
The  code  is  created  from  generic  CMES  macros  that  are  populated  with  the  proper 
calculated  values.  These  macros  can  also  be  edited  by  the  inspector  to  ensure  an  easy 
software  upgrade  and  to  customize  the  output  of  the  inspection  plan. 


Chapter  7 
Future  Work 


Our  efforts  today  and  what  wt  have  done  so  far 
are  but  building  blocks  la  a  huge  pyramid  to  come  — 

Knowledge  begets  knowledge.  The  more  I  see, 
the  more  impressed  lam  —  not  with  what  we  know — but 
with  how  tremendous  the  areas  are  that  are  as  yet  unexplored. 

-  Ll  CoL  John  H.  Glenn,  Jr. 


The  RDS  is  a  large  research  project  that  has  accomplished  much,  but  has  many 
new  avenues  to  explore.  With  respect  to  inspection  planning  and  this  research,  the 
future  work  emails  improvements  to  existing  techniques,  as  well  as  new  implementa¬ 
tions: 


Variant  process  planning :  variant  planning  would  be  in  addition  to  the 
current  generative  process  planning.  Variant  process  planning  begins  with 
a  previous  inspection  plan  and  updates  it  according  to  the  current  pan¬ 
model  and  tolerances. 

Intelligent  inspection  point  placement  on  toleranced  surfaces:  currently  the 
points  are  placed  on  the  surfaces  by  a  random  process.  An  intelligent 
placement  based  on  inspection  rules  or  neural  net  learning  would  improve 
the  evaluation  results. 

Intersecting,  interacting  features:  an  addition  to  the  IPEM  would  provide 
intelligent  point  placement  on  a  surface  that  is  not  complete  because  of 
feature  interaction. 

Neural  network  learning  of  scheduling  weights:  producing  the  probe  path 
schedule  based  on  inspection  rules  requires  the  proper  weighting  of  rules 
when  they  conflict.  A  separate  associative  memory,  such  as  the  EAM.  can 
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be  used  to  learn  the  inspection  weights  in  relationship  to  the  pan-model 
and  tolerance  callouts.  When  a  similar  pan-model  is  encountered,  the  same 
weights,  or  a  linear  approximadon  of  the  weights,  can  be  used  when  creat¬ 
ing  the  rule  matrices. 

Evaluation  functions',  currently  the  evaluation  functions  are  performed  within 
the  CMM  language,  CMES,  which  usually  entails  leas  squares  algorithms. 
More  efficient  algorithms  can  operate  upon  the  measurement  points  which 
will  result  in  more  accurate  tolerance  evaluation. 

Five  dof  probe:  extending  the  inspection  planning  to  five  dof  will  involve  a 
large  undertaking,  but  will  produce  better  results.  The  point  placement 
techniques,  MR  sequencer,  and  collision  avoidance  algorithm  must  all  be 
modified. 

Representing  fixtures  in  simulation  and  collision  avoidance:  solid  fixture 
structures  will  provide  a  safer  path  for  the  inspector.  In  addition,  intelli¬ 
gent  fixture  selection  and  placement  will  aid  the  inspector  and  produce 
more  options  for  setup  orientation  selection. 

More  human  interaction:  yes,  more.  Allowing  human  interaction  into  key  ar- 
ex>  of  the  IPEM  will  speed  the  process  and  guide  it  into  a  desired  result. 
For  example,  the  current  setup  selection  is  a  computationally  expensive  al¬ 
gorithm:  however,  this  can  be  replaced  by  an  optional  testing-surface  se¬ 
lection  by  the  inspector. 
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Appendix  A 

CMES  Macros  for  Design/Tolerance  Feature  Combinations 


BOSS 

joi  CMES  maCT 

♦  #OD,axis//Ax\y\zNdiam,0,0^ol 

#MCaxisVlcar_val 

-L  #OD^xis\x\y\ziMiam  \SP,1 

#MC,axisNclear_val 
#OD,axis\x\y\z2Miam\SP,2 
.  #MC,axis''ciear_vai 
UP,1  7SDl,4 
{  AQ,4JL,axis,/DL\iol  } 

{  AQ,4J,axisJ^tol } 


//  SA,10 

#OD  axis  l\x  l\v  l\z  1  aMiam  1  NSP.l 
#OD,axis  l\x  l\v  l\zl  bMiam  i  \SPJ2 
#MC,axis  l'ciear_vai 
UP,l,2NDI,axis 

!  **  note  origin  has  been  shifted  to  axis  of  boss 
#OD4ucis2\x2\y2Sz2a''diam2  \SP,1 
#OD,axis2\x2\v2va2bViiam2  \SP,2 
#MC,axis2>ciear  _val 
UP,1,2\DI,4 
{  AP,4X,axis7DL\iol } 

{  AP,4X,axisPMol  } 

RA,10 
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126 


#0D,axis\xl\yl\2*diam  \SP,1 
#MC,axis''dear_val 

{  ...  n  total  times  (1  line):  2  _  n  _  40 ...  ) 
UG,l,n\DI,4,n 
{  FS,4\iol ) 

(  FS,4,axisJ**ol } 


O  SA,10 

#OD  ,axis\x\y\z  lVHam  1 

#MC,axisvclear_val 

DI,4 

#OD  ,axis\x\y\z2Miam2 
#MCaxisNciear_val 
CN,4JL^Lxis,LyD^oi 
RA,10 


Z.  !  for  angles  other  than  90  deg 
#MC,axis\x\y\z 

#PP,axis\x\y\z  NSP.l 

(  repeat  at  least  n  >  2  times  } 
UG,U\DI.4 
{  AA,4vUdatum7D  } 

{  AA,4,L,datumVL  } 


axis-D  #OD ,axis\x\v\z  l\liam  \SP,1 

#MC.axis'«lear_val 
#OD,axis..x,y,z2Viiam  \SP,2 

#MC.axis\ciear_val 
UP,l,2\DI,axis_naine 


BLINP/THKOUGH  HOLE 

I2i  CMES  macro 


#ID,axis//Ax\y\zvdiam,0,(Nol 

#MC,axis''dear_val 
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X  #ED,axis\x\y\z  lMiam  \SP,1 

#MCaxis^clear_val 
#ID,axi$\x\y\z2>diam  \SP,2 
fMCaxis'clear.val 
UP,1,2\D!,4 
{  AQ,4X^axisjT)L\iol } 

{  AQ,44,axis4^ol  } 


//  SA.IO 

#ID  .axis  l\x  l\y  INz  1  a'diam  1  NSP,1 
#ID  .axis  lNx  l\y  INz  1  bViiam  1  NSP.2 
#MC,axis  lNclcar.val 
UP,l,2SDI,axis 

!  **  note  that  origin  has  been  shifted  to  the  axis  of  the  hole 
#EDxxis2\x2\y2Nz2aViiam2  \SP,1 
#ID,axis2\x2\y2\z2bViiarii2  \SP,2 
#MCaxis2\clear_vai 
UP,  1,3014 
{  AP,4X,axis^DLNtol  } 

(  AP,4X,axisJ^tol } 

RA.10 


—  #ID,axis\xl\yl\z''diam  ''SP.l 

{  ...  n  total  times  (1  line):  2  _  n  „  40 ... } 
UG,l.n\DI,4,n/ 

{  FS,4.axisJ3\tol  } 

(  FS.4\tol } 

O  SA.10 

#ED  ,axis\x\y\z  IMiam  1 

#MC,axis''clear_val 

DI,4 

#DD,axis\x\y\z2Miam2 

#MC.axisvciear_val 

CN,4.LjjrisXVD\tol 

RA,10 


Z 


!  for  angles  other  than  90  deg 
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#MC,axis\x\y\z 

#PP,axis\x\y\z  \SP,1 

{  repeat  at  least  n  >  2  times  } 
UG.UNDI.4 
{  AA,4X,datum,/D  ) 

{  AA,4X,datum7L  } 


axis-D  #ED  ,axis\x\y\z  lVliam  \SP,1  * 

#MC,axisvclear_val 
#ID,axis\x\y\z2Sdiam  \SP,2 

#MC,a»svclear_vai 
UP,  13DI.axis_.name 


EDGE  CUT 
IOi  CMES  macro 

Z.  !  assume  datum  is  already  created 

#MOxl\yl\zl 

#PP,axis\zO  \SP.1 

{  ...  n  total  times  (2  lines):  3  <  a  <  40 ...  } 

UG,l,n\AX,4,n 

AA,4JP,axism/Paxis\angie\iol 


♦  #MOxl\yl\zl 

#PP,axis\zO  \SP,1 

{  ...  n  total  times  (2  lines):  3  <  n  <  40 ...  } 

UG,l,n\AX.4,n 

Nl,4,datumAiol(.5) 

!  AN,4,datumA90,tol(.5) 


THROUGH  SLOT 

lai  CMES  macro 

X  #MC\xl\yl\zl 

#PP,axis\vO  \SP.1 

{  ...  n  total  times  (2  lines):  6  <  n  <  40 ...  } 
UP.13CM.axis  \SP,1 
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UPJ,4SCMoxis  NSP.2 

UP^.SSCM^xis  NSP,3 

(  ...  n  total  tunes  (1  line):  3  <  n  <  20 ... } 

UG,l,n\AX.4ji 

Nl,4,axis/\rol(..5) 

!  AN,4,datum/S90,tol(.5) 


ELAMAE^UREACES 

ml  CMES  macro 

♦  #MC\xl\yl\zl 

#PP,axis\zO  \SP,1 

{  ...  n  total  rimes  (2  lines):  3  _  n  _  40 } 

UG,l,n\AXAn 

Nl,4,dammAtol(J) 

!  or  AN,4,datum/S90,tol(.5) 

//  #MCvxl\yl\zl 

#PP,axis\zO  \SP,1 

(  ...  n  total  rimes  (2  lines):  3  £  n  40  _  ) 

UG,U\AX.4,n 

AP,4J>,axisJ>^PStol 

-  #MC\xl\yl\zl 

#PP.axis\zO  \SP.1 

(  ...  n  total  times  (2  lines):  2  <  n  <  40 ... } 

UG,l,n\AX+,4 

FS,4,P,axisJNtol 

{  repeat  above  code  for  each  new  line  } 


Z  #MC\xl\yl\zl 

#PP^urisNzO  \SP,1 

{  ...  n  total  times  (2  lines):  3  <  n  <  40 ...  ) 
UG.ljMX.4 

AA,4,P,axis.n/Paxis\angie\iol 


a  #MOxl\yl\zl 

#PP^xis\p0  \SP.1 
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{  ...  n  total  tiroes  (2  lines):  3  <  n  <  40 ...  } 
FF.axisv'P'tol 


Appendix  B 
CMES  Quick  Reference 


i 


Command 

AX 

N1 

N2 

3T 

MD 

#MC 

#?P 


Bsaspcafin 

Axis.  The  normal  of  the  plane  containing  the  points  given  is  created. 

If  more  than  three  points  are  given,  a  least-squares  algorithm  is  used  to 
compute  the  plane. 

Normal  1.  This  creates  the  normal  of  a  plane  from  2  measured  points. 
The  third  point  is  calculated  from  the  normal  of  a  specified  plane. 

This  ensures  mathematical  mutual  perpendicularity  needed  for  (latum 
reference  frames. 

Normal  2.  This  creates  the  normal  of  a  plane  from  1  measured  point. 
The  second  and  third  points  are  calculated  from  the  normal  of  two 
specified  planes. 

Point  of  Intersection.  This  command  determines  the  point  of 
intersection  of  that  have  been  created  by  a  combination  of  AX.  Nl.  and 
N2  commands. 


Master  Datum.  Follows  the  MD  command  to  make  the  intersection 
point  the  workpiece  origin. 

Automatic  Move  Course.  The  #  signifies  that  the  command  will 
physically  move  the  probe,  and  collision  avoidance  techniques  need  to 
be  applied.  The  MC  command  is  a  fast  move  and  needs  to  be  well 
clear  of  the  part. 

Automatic  Point  with  Probe  Compensation.  This  command  moves  the 
probe  slowly  in  one  direction  to  take  a  measurement  from  the  pan. 
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#  ID  Automatic  Inside  Diameter.  Inspects  a  hole  by  accelerating  to  the 
point  above  the  hole,  enter  the  hole,  and  probe  the  inside  of  the  hole. 

#OD  Automatic  Outside  Diameter.  Inspects  a  boss  in  the  same  manner  as  a 
hole. 

Ill  Tolerances.  Backslashes  are  appended  to  end  of  any  evaluation 

command  to  indicate  tolerancing.  Equal  bilateral:  /  =  ±val.  Unequal 
bilateral:  //  =  hival,  loval.  True  position:  III  -  tp-diameter.  True 
Position  plus  bonus:  M  =  tp-diameter. 

SP  Save  Point.  Save  a  point  for  future  use. 

UP  Use  Point.  Use  a  saved  point. 

FS  Form  -  Straightness.  Determines  the  straightness  of  a  line. 

FF  Form  -  Flame ss.  Determines  the  flatness  of  a  surface. 

AP  Attirude  -  Parallelism.  Determines  the  parallelism  of  one  feature  to 
one  (or  two)  other  features. 

AQ  Attitude  -  Squareness.  Determines  the  perpendicularity  of  one  feature 
(or  two)  to  another. 

AA  Attitude  -  Angularity.  Determines  the  angularity  of  one  feature  to 
another. 

CN  Concentricity.  Determines  the  concentricity  of  a  point  to  a  line,  line  to 
a  point,  or  line  to  a  line. 
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Appendix  C 

Artificial  Neural  Net  Code  in  C 


♦include  <stdio.h> 

♦include  <mathJ» 

♦include  <ctypeJj>  • 

♦include  <fcntl.h> 

♦define  DIM  20 
♦define  UL  500.0 
♦define  LL  -500.0 

void  fpm_sol(intQ[DI^,floatG[DI^,char'*); 
int  in_dim: 

mam(int  argc,  char  ’argvQ) 

( 

int  i,  j,  Ic,  z.  seed.  maxiter=  100000,  v(D[M][DlM],  th,  iter,  sp,  sf2 ; 
int  al=l,  a2=l,  b=2,  c=2,  dial,  d2=l,  sl=0,  s2=-l,  S  [DIM]  [DIM]; 
int  ume_step=l,  p,  pi,  p2,  sal.  sa2(DIM],  hi,  h2[DIM]; 
float  fl=l.O.  sf,  sb,  sc,  dis,  min,  max: 

float  du(DIMl[DIM],  u(DIM][DIM],  d[DIM][DIM],  dd(DlM][D[M],  F[DIM][DIM]; 

Read_weights(argv(l],  d,  F,  S); 
sp=0; 

r  minimum  shift  wieghts  */ 
for(i=0:i<in_dim:i-*-t-)  { 
min=l000: 
for(j=0:j<in_clim:j-H-) 
if((»!=j)&&(d(ilO]<min))  min=d(i][j]; 
fortj=0;j<in  _dim: j++) 
if(i!=j)  dd(i][j]=d[i]rj]-min: 

1 


r  initialize  */ 
iter  =  0; 

for(i=0:i<jn_dim.i-H-) 
for(j=0: j<in  _dim:j-w-)  ( 
u(i](jl  =  -randO/100000.0: 
v[i][j]=0: 

} 
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v(sp|(0]*l;  r  v(epj(in_dim-ll*l:  */ 

whilefiteronaxitcr)  { 
r  evaluate  "I 
for(U*0;i<in_dimu-t-c) 

if  (i!s*sp)  r  4A(ii=ep)  •/ 
foirtj=  1  :j<jn_diin;j-M-) 
if(u{ilQ>0)  v(illj>l: 
else  v(il(j}30; 

/*  rules  manipulation  */ 
if  (si  !«  0) 

for  (i=  l :  i<in_dim:  i-*-*-) 
for  (j«l:  j<in_dim:  j++) 
v(il(j]  =  v(nO]&AS(il(D; 

th  a  0; 
sa2[0]=0: 

r  column  summation  */ 
for(j=  1  ;j<in_dim:]-M-)  { 
sa2(j]  =  0:  h2(fl  =  0; 
for(p^,p<in_<lim-.p*+) 
sa2(j]  =  sa2[j]+v(pj(j]; 
if(sa2(j]=0)  h2(j]  =  1: 
sa2(j]=sa2(j]-l; 

) 

I*  row  summation  */ 
for(i=0;i<in_dim3++) 
if  (i!=sp)  ( 

sal  =0;  hi  =0; 
for(j=  1  ;j<m_dim:]-M-) 
sal  =  sal+v(i](fl; 
if  (sal  =0)  hi  =  1: 
sal  =  sal-1: 

for(j=  l  ;j<in_dim:j+-*-)  ( 
sb  *  0:  sf  =  0: 
for(p=0:p<in_diin;p++)  { 
if  (p!=i)  sb  =  sb-Kv(pl(j- 1]  +  v(pJ(j+l])*dd(iKp]; 

if  (p!=i)  sf  =  sf+<v{p](j-l]*Ftp][i]  +  vfplLh-U-FinCp]); 

1 

sf2  =  0: 

for(k=  l  ;k<in  _dira:k-H-) 

if  ((k!=i)  &&  (FWM  <  0.0))  sf2  +=  v(i][j]*v(k][H]; 
if  (sf2  =s  l)  sf  =  0.0: 
sf2  =  0: 

for(k=  lJc<in_dimJc-M-) 

if  ((k!=i)  &A  (F(k](i]  <  0.0))  s£2  +=  v(k][j-l]*v(i][j]; 
if  (sf2  =  1)  sf = 0.0: 
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sc  =  0: 

tf<(v{*l □]=  !>&4fe<sa2U-  ll=»0)&4tCsa2U-»- 1 1«0»  ( 

for(p«0:p<in_diin;p-t-*-)  ( 
tf(v(pl{j-l]*=l)  pl=p; 

‘f(v(plU+l]=l)  p2=p; 

) 

iff(p  1  !=0A&fp2!=O£A(p  1  !*p2)) 
sc  *  dd{i][pl]4dd(i][p2]-dd{p2](pl]-dd(pljlp2); 

} 

ch  =  ih  +  abs(al)  +  abs(sa2UD; 

/*  neuron  motion  equation  7 

du(i][j]  a  -al*sal-a2*sa2(j]  -  b*sb  -  c*sc  ♦  dl*hl+d2*h2tQ  -  fl*sf  -  s2*S[i][fl; 
r  update  •/ 

u(i][j]  s  u(i]  (j]+du(i] [j] *time_step; 

/*  threshold  limits  7 
if  (u(ilUl  >  UL)  u(i](j]  =  UL; 
if(u(i][j]<LL)u(iKj]=LL; 

) 

} 

if(th=0)  break; 
iter=tter+l; 

} 

fpm_sol(v,  d,  argv); 

} 

void  fpra_sol(ini  vQ[DIMl,  float  dQ[DIM]t  cbar  *outfiteQ) 

1 

int  i,j; 

char  fname(24]; 

FILE  *fp: 

strcpy(fhame,  strcat(oud:Ile(  1  j .out")); 
printfC^nNnPrinting  to\"%s\" ",  fhame); 
fp  3  fopen(fname.  "w"); 
for(j=0;j<in_dim:j++) 
for(i=0;i<in  dima-t-v) 
if  (v(ilD1  =  D  ( 

tprimf(fp,'%.Of  %.0f  ",d(in_dim][i],  d(in_dim+l][i]); 
printt'("%.0f  %.0f,  \d[in_dim][i],  d(ia_dim+l][i]); 

} 

fclose(fip); 


